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(54) Motion estimation method and apparatus for calculating a motion vector 



(57) A motion estimation method and a motion esti- 
mation apparatus for calculating a motion vector to esti- 
mate a current picture (Pa) partially forming a video 
sequence on the basis of first and second reference pic- 
tures (Pb and Pc) partially forming the video sequence. 
In the method and apparatus, a reference block (2) 
included in the first reference picture (Pb) similar to a 
current block (1) included in the current picture (Pa) is 
specified and multiplied by a first coefficient. By per- 
forming a subtraction between the multiplied reference 
block and the current block (1), a template block indica- 
tive of a difference between the multiplied reference 
block and the current block (1 ) is obtained. On the other 
hand, candidate blocks (6) are calculated by multiplying, 
by a second coefficient, each reference blocks (3c) 
included in a search window (3) partly forming the sec- 
ond reference picture (Pc). Based on the candidate 
blocks (6) and template block (4a) are calculated distor- 
tion values each indicative of a difference between the 
following interpolated blocks and current block (1 ). Each 
of the interpolated blocks is indicative of a mean 
between the specified reference block (2) of the first ref- 
erence picture (Pb) and each reference blocks (3c) of 
the search window (3). 
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Description 

BACKGROUND OF THE INVENTION 

1 . FIELD OF THE INVENTION 

The present invention relates to motion estimation method and apparatus for calculating a motion vector, and more 
particularly to method and apparatus for calculating a motion vector to estimate a current picture partially forming a 
video sequence on the basis of a reference picture partially forming the video sequence. 

2. DESCRIPTION OF THE PRIOR ART 

In the recent years, information transmitting media such as news paper, TV and radio have been flooded with infor- 
mation relative to "multimedia" to which ardent attention is paid by all the world. Although variously interpreted, the term 
"multimedia" as used herein is considered to be information presented in the combination of text, graphics, video, sound 
and the like. Since such information is generally handled by a computer, data representative of the video and sound as 
well as the text and graphics are required to be digitized. When data representative of a video sequence such as a 
motion picture are digitized, the amount of digitized data is extremely large in comparison with data indicative of sound, 
text or graphics. For this reason, the data of a motion picture to be handled by the computer are required to be com- 
pressed when the data is stored in a storage device or transmitted over a communication line. 

Up until now, there have been proposed a wide variety of data compression processes for compressing the data of 
a motion picture in accordance with a correlation between two pictures (occasionally referred to as frames) partly form- 
ing the motion picture. Such a data compression process is applied to a so-called basic inter -frame predicting coding 
method and a so-called motion compensation inter-frame predicting coding method which will become apparent as this 
description proceeds. 

First, the former basic inter-frame predicting coding method will be described hereinlater with reference to FIG. 43. 
This method comprises a step of calculating a difference between pel data of each pel (picture element) of a current 
picture 1 2 and pel data of each pel of a reference picture 1 1 corresponding in position to each other, the current picture 
1 2 and the reference picture 1 1 partially forming a motion picture. The reference picture 1 1 may be either of feature and 
past pictures with respect to the current picture 12 upon condition that data indicative of the reference picture 1 1 have 
been already encoded. The method further comprises steps of comparing the difference with a predetermined thresh- 
old value, and dividing the pel data of the reference picture 1 1 into two data groups consisting of a significant pel data 
group having differences each larger than the threshold value and an insignificant pel data group having differences 
each equal to or less than the threshold value. The significant pel data are considered to be useful data that are not 
allowed to be omitted when the current picture 1 2 is estimated on the basis of the reference picture 11 . On the contrary, 
the insignificant pel data are considered to be unnecessary data that are allowed to be omitted when the current picture 
1 2 is estimated on the basis of the reference picture 1 1 . 

As shown in FIG. 43, if a person image 10 in the reference picture 1 1 has been moved right in the current picture 
12, there are produced two significant pel data regions by reference numerals of 13 and 14, respectively and an insig- 
nificant pel data region indicated by a blank surrounding the significant pel data regions 13 and 14. By adding, to pel 
data of a pel of the reference picture 1 1 within the significant pel data regions 13 and 14, a difference between pel data 
of a pel of current picture 12 and the pel data of the pel of the reference picture 1 1 corresponding in position to each 
other, can be estimated the pel data of the pel of the current block picture 1 2. Pel data of each pel of the current picture 
1 2 within the insignificant pel data region are represented by pel data of a pel of the reference picture 1 1 corresponding 
in position to the pel of the current picture 12. 

In the case that the basic inter-frame predicting coding method is utilized, the difference data between two pels 
decrease fast as the significant pel data is fewer. This means that compression efficiency can be enhanced. The 
number of the significant pel is decreased by setting the threshold value large and as a consequence the compression 
efficiency can be further enhanced. If, however, the threshold value becomes extremely large, motion of the image 
looks to be jerky, or moving portion of the image looks to be at a standstill in part, thereby resulting in an drawback of 
the fact that image quality becomes poor. 

In view of the property of the basic inter-frame predicting coding method, the compression efficiency is enhanced 
under the condition that variation between the current picture and the reference picture is small because of the fact that 
the difference data are decreased in proportion to the see of standstill image regions of the current picture with respect 
to the reference picture. The following motion compensation inter-frame predicting coding method, however, realizes 
higher compression efficiency in comparison with the basic inter-frame predicting coding method. 

Likewise, on the assumption that the person image 10 in the reference picture is moved right in the current picture 
12, the motion compensation inter-frame predicting coding method is explained hereinafter with reference to FIG. 44. 
The motion compensation inter-frame predicting coding method comprises a step of calculating a motion vector MV 
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indicating the movement distance and movement direction of the person image 10 between the reference picture 11 
and the current picture 12. The motion compensation inter-frame predicting coding method further comprises a step of 
estimating the person image 10 in the current picture 12 with the aid of the motion vector MV and pel data defining the 
person image 10 in the reference picture 1 1. In this case, there is produced only one significant pel data region 13 as 

5 shown in FIG. 44. Accordingly, the motion compensation inter-frame predicting coding method is superior to the basic 
inter-frame predicting coding method in the fact that the number of the significant pels can be sharply decreased and 
accordingly that the compression efficiency can be extremely enhanced. 

The motion compensation inter-frame predicting coding method will be described hereinafter in detail with refer- 
ence to FIGS. 45 to 47. According to ITU-T (International telecommunication Union-Telecommunication Standardiza- 

w tion Sector) H.261, the motion compensation inter-frame predicting coding method comprises steps of dividing a 
current picture 20 shown in FIG. 45 into a plurality of blocks including a block (referred to hereinlater as a current block) 
21, specifying a search window 31 including blocks (referred to hereinlater as candidate blocks) in a reference picture 
30, and calculating distortion values each indicative a difference between the current block 21 and each of the candi- 
date blocks. The distortion value is calculated by converting, into positive numbers, local distortion values each indica- 

15 tive of a difference between pel data of each pel of the current block 21 and pel data of each pel of the candidate block 
corresponding in position to each other, and summing up the converted local distortion values. The motion compensa- 
tion inter-frame predicting coding method further comprises steps of specifying a candidate block 32 which provides a 
minimum distortion value, i.e. the smallest in the distortion values calculated in the above mentioned manner, and cal- 
culating a motion vector representative of a distance between and a direction defined by the current block 21 and the 

20 candidate block 32. By an encoder not shown, are encoded the motion vector MV thus calculated and the distortion 
value between the candidate block 32 included in the reference picture 30 and the current block 21 . 

FIGS. 46(a) and 46(b) represent relations between the current block 21, search window 31 and candidate blocks 
32. If the current block 21 and the search window 31 contain N columns of M pels and L columns H pels as shown in 
FIGS. 46(b) and 46(a), respectively. The search window 31 includes (L-M+1)x(H-N+1) candidate blocks 32 similar to 

25 the current blocks 21 . In the case that pel data of a pel at the top left-hand corner of current block 21 in FIG. 46(b) is 
indicated by a(0,0), pel data of each of the candidate blocks 32 corresponding in position to the pel data a(0,0) of the 
current block 21 are included in an area defined by oblique lines in FIG. 46 (a). 

FIGS. 47 (a) and 47 (b) represent a relations between pel data of the current block 21 and pel data of each of the 
candidate block 32 corresponding in position to each other. By b(!+m, h+n) in Fig. 34(a), is indicated pel data of each 

30 of the candidate blocks corresponding in position to the pel data a(m, n)of the current block 21 shown in FIG. 47(b). Pel 
data b(l,h) in the search window 31 shown in FIG. 47 (a) is pel data at the upper left-hand corner of the candidate block 
32 and accordingly corresponds in position to the pel data a(0, 0) of the current block 21 . In the current block 21 , search 
window 31 and candidate block 32 shown in FIGS 47(a) and 47(b), a distortion value between the current block 21 and 
the candidate block 32 is indicated by D(l,h) defined as follows: 

35 

M-1 /V-1 M-1 AM *«- 

D V< h )~ £ ^ll^(m+/,n+/7)-a(m t n)||= £ "£\\d(l,h)\\ 

m=0n=0 m=0n=0 

40 

Note that 1 f is a notation called the norm and that d(l,h) is defined by an equation, d(l,h)=b(m+l, n+h)-a(m,n) , 
and represents a local distortion value indicative of a difference between pel data of two pels corresponding in position 
to each other. The norm arithmetic is absolute-value arithmetic, square arithmetic or the like. The above-mentioned 
process of comparing a block of the current picture with each of blocks of the reference picture in motion compensation 

45 inter-frame predicting coding method is so-called as a block matching method, particularly as a full search block match- 
ing method if the current block is compared with all the candidate blocks included in the search window. 

There has been proposed MPEG (Moving Pictures Experts Group) including MPEG1 and MPEG2 which are sup- 
ported by ISO/IEC (International Organization for Standardization /International Electrotechnical Commission) 1 1 172- 
2 and 13818-2, respectively. In MPEG, the pels handled in the foregoing ITU-T H. 261 are referred as integer pels. In 

so addition to the integer pels, the MPEG generates and handles half-pels each interposed between the adjoining integer 
pels. Four integer pels b(0,0), b(0,l), b(1 ,0) and b(1 ,1) are shown in FIG. 48 as forming a matrix array indicated by two 
columns of two pels. Between and based on the integer pels b(0,0) and b(1,0), the integer pels b(0,0) and b(0,1), and 
the integer pels b(0,0) and b(1.1). are generated half-pels Hh, Hvand Hd defined as follows: 

55 Hh = {b(0,0)+b(1,0)}/2 

Hv = {b(0,0)+b(0,1)}/2 

Hd = {b(0,0)+b(1,0)+b(0,1)+b(1,1)}/4 
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The generation of the half-pels makes it possible to search, from the search window, the candidate blocks horizontally, 
vertically and diagonally aligned at not one-pel pitches but half-pel pitches in the search window, so that the precision 
of the motion estimation can be enhanced more and more. 

As shown in FIG. 49, the MPEG prepares the motion estimation a bi-directional prediction mode utilizing not only 

s a forward prediction mode wherein the current picture is estimated with reference to the past picture, but also a back- 
ward prediction mode wherein the current picture is estimated with reference to the future picture. The implementation 
results of the forward and backward prediction modes are compared in prediction ability with each other. Between the 
forward prediction and the backward prediction is chosen one superior to the other. The implementation of the chosen 
mode is adopted, so that the prediction ability can be enhanced. 

io The MPEG also prepares the motion estimation a bi-directional interpolation prediction mode wherein the current 
picture is estimated with reference to an interpolated picture that is representative of a mean between the past picture 
and the future picture. The bi-directional interpolation prediction mode is used in order to further enhance the prediction 
ability in comparison with the bi-directional prediction mode. 

The interpolated picture is formed depending upon a way which is described hereinafter with reference to FIGS. 

15 50(a) and 50(b). In FIG. 50(a), reference numerals 50, 60 and 70 designate the current picture, a first reference picture 
previous to the current picture and a second reference picture subsequent to the current picture, respectively. By utiliz- 
ing the aforementioned motion compensation inter-frame prediction technique, a reference block B included in the first 
reference picture 60 and most similar to a current block A included in the current picture 50 is specified, thereby obtain- 
ing a motion vector MV indicative of a displacement between the reference block B and the current block A. The motion 

20 vector MV is scaled with respect to the second reference picture 70 to obtain a scaled vector SV. In this instance, the 
motion vector MV is identical with the scaled vector SV because of the fact that a time-lag between the current picture 
50 and the first reference picture 60 is equal to that between the current picture 50 and the second reference picture 
70. Based on the scaled vector SV, a search window 72 partially forming the second reference picture 70 is specified. 
The search window 72 extends from a pel 71 included in the second reference picture 70 and most close to the end 

25 point of the scaled vector SV. 

The search window 72 includes a plurality of reference blocks C1 , C2 ... Cn. In accordance with an expression indi- 
cated by (B+Cn)/2 , interpolated blocks Dn (not shown) each indicative of a mean between the reference block 62 and 
each of the reference blocks Cn are calculated. The distortion values each indicative of a difference between each of 
the interpolated blocks Dn and the current block A are calculated by an expression indicated by llDn-Aj|. This means that 

30 the number of the distortion values is "n". The minimum distortion value is selected from among the distortion values, 
and as a consequence a target interpolated block is specified from the interpolated blocks Dn. 

The MPEG further prepares the motion estimation a dual-prime prediction mode partly described hereinafter. In 
FIG. 51 , reference numerals 81 and 82 designate a first field and a second field, respectively, of a current picture, while 
reference numerals 91 and 92 designate a first field and a second filed, respectively, of a reference picture. The current 

35 picture has a current block which consists of a field block 81 a included in the first field 81 and a field block 82b included 
in the second field 82. The dual-prime prediction mode comprises a step of applying the aforementioned motion com- 
pensation inter-frame prediction to an estimation of the field block 81 a with reference to the first field 91 of the reference 
picture to calculate a field motion vector FV. The field motion vector FV is scaled with respect to the second field 92 of 
the reference picture to obtain a scaled vector SV1 . Assuming that a half-pel of the second field 92 most close to the 

40 starting point of the scaled vector SV1 forms the uppermost half-pel 92P of a reference block included in the second 
field 92, a search window for the motion estimation is formed by nine overlapping field blocks surrounding the half-pel 
92. Specifically, the nine field blocks consist of a center reference block including a half-pel 92P as an uppermost pel, 
and eight field blocks deviated vertically, horizontally and diagonally by half-pel pitch from the center reference block. 
The dual-prime prediction mode further comprises steps of calculating interpolated blocks each indicative of a mean 

45 between the reference block 91a of the first field 91 and each of the nine reference blocks included in the search win- 
dow, and calculating distortion values each indicative of each interpolated block and the current block 81 a. From among 
the calculated distortion values, the minimum distortion value is selected to obtain a differential motion vector repre- 
sentative of a displacement between the half -pel 92 P and the uppermost pel of the reference block of the second field 
92 which is used for the calculation of the minimum distortion value. In case that a reference block 92a is used for the 

so calculation of the minimum distortion value, a vector DMV shown in FIG. 51 serves as the differential motion vector. 

The field motion vector FV is shifted from the field block 81a to the field block 82b until the endpoint of the field 
motion vector FV is coincided with the uppermost pel of the field block 82b. The shifted field block FV is denoted by "FV m 
in FIG. 51. By the starting point of the field motion vector FV is specified a field block 92b of the second field 92. The 
field motion vector FV is scaled with respect to the first field 91 of the reference picture to obtain a scaled vector SV2 

55 so that a half-pel 91 P of the first field 91 most closed to the starting point of the scaled vector SV2 is specified. The dif- 
ferential motion vector DMV is shifted from the half-pel 92P to the half-pel 91 P, and consequently a field block 91b is 
specified. On the basis of the field block 91b and the field block 92b is calculated an interpolated block indicative of a 
mean between the field block 91b of the first field 91 and the field block 92b. Based on the interpolated block and the 
current field block 82b, a distortion value indicative of a difference between those blocks is calculated. In case of the 
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dual-prime prediction mode, the field motion vector FV and the differential motion vector DMV serve as motion vectors 
for the motion estimation. 

A drawback is encountered in the motion estimation according to a prior-art bi-directional interpolation prediction 
in that not only an apparatus or a circuit for performing the motion estimation becomes extremely large but also the 

5 motion vector calculation takes extremely long time. The reason is that it is required not only to calculate the distortion 
values the number of which is equal to that of the candidate blocks Cn included in the search window, but also to cal- 
culate the interpolated blocks the number of which is equal to that of the candidate blocks. In addition, the same draw- 
back is encountered in the motion estimation according to a prior-art dual-prime prediction becauseof the fact that it is 
required to calculate the interpolated blocks the number of which is equal to that of candidate blocks. 

w The present invention contemplates provision of a motion estimation method and apparatus overcoming the draw- 
backs of prior-art motion estimation method and apparatus of the described general nature. 

SUMMARY OF THE INVENTION 

15 According to one aspect of the present invention, there is provided a motion estimation method for calculating a 
motion vector to estimate a current picture partially forming a video sequence on the basts of first and second reference 
pictures partially forming the video sequence. The current picture is partially formed by a current block including a plu- 
rality of pels represented by pel data sets, respectively. The first reference picture is formed by reference blocks each 
equal in size to the current block. Each of the reference blocks of the first reference picture includes a plurality of pels 

20 represented by pel data sets, respectively. The second reference picture is formed by reference blocks each equal in 
size to the current block. Each of the reference blocks of the second reference picture includes a plurality of pels repre- 
sented by pel data sets, respectively. The motion vector is indicative of a displacement between the current block and 
one of the reference blocks of the second reference picture. The method comprises a step (a) of specifying a reference 
block similar to the current block from among the reference blocks of the first reference picture, a step (b) of multiplying 

25 each pel data set of the specified reference block by a first coefficient, a step (c) of obtaining a template block by calcu- 
lating pel data sets each indicative of a difference between each multiplied pel data set of the specified reference block 
and each pel data set of the current block corresponding in position to each other, a step (d) of specifying part or the 
whole of the second reference picture as a search window, and a step (e) of obtaining candidate blocks by multiplying, 
by a second coefficient, each of the pel data sets of the reference blocks included in the search window, and a step (f) 

30 of calculating, on the basis of the pel data sets of each of candidate blocks and the pel data sets of the template block, 
distortion values each indicative of a difference between each of interpolated blocks and the current block. Each of the 
interpolated blocks is indicative of a mean between the specified reference block of the first reference picture and each 
of the reference blocks of the search window. The method further comprises a step (g) of selecting a minimum distortion 
value from among the distortion values, and a step (h) of specifying a reference block of the second reference picture 

35 bringing the minimum distortion value to obtain the motion vector. 

According to another aspect of the present invention, there is provided a motion estimation apparatus for calculat- 
ing a motion vector to estimate a current picture partially forming a video sequence on the basis of first and second ref- 
erence pictures partially forming the video sequence. The current picture is partially formed by a current block including 
a plurality of pels represented by pel data sets, respectively. The first reference picture is formed by reference blocks 

40 each equal in size to the current block. Each of the reference blocks of the first reference picture includes a plurality of 
pels represented by pel data sets, respectively. The second reference picture is formed by reference blocks each equal 
in size to the current block. Each of the reference blocks of the second reference picture includes a plurality of pels rep- 
resented by pel data sets, respectively. The motion vector is indicative of a displacement between the current block and 
one of the reference blocks of the second reference picture. The apparatus comprises block specifying means for spee- 
ds ifying a reference block similar to the current block from among the reference blocks of the first reference picture, and 
template block obtaining means for obtaining a template block by multiplying each pel data set of the specified reference 
block by a first coefficient and by calculating pel data sets each indicative of a difference between each multiplied pel 
data set of the specified reference block and each pel data set of the current block corresponding in position to each 
other. The apparatus further comprises search window specifying means for specifying part or the whole of the second 

so reference picture as a search window, candidate block obtaining means for obtaining candidate blocks by multiplying, 
by a second coefficient, each of the pel data sets of the reference blocks included in the search window, and distortion 
calculating means for calculating, on the basis of the pel data sets of each of candidate blocks and the pel data sets of 
the template block, distortion values each indicative of a difference between each of interpolated blocks and the current 
block. Each of the interpolated blocks is indicative of a mean between the specified reference block of the first reference 

55 picture and each of the reference blocks of the search window. The apparatus further comprises distortion selecting 
means for selecting a minimum distortion value from among the distortion values, and motion vector calculating means 
for calculating the motion vector by specifying a reference block of the second reference picture bringing the minimum 
distortion value. 
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According to a further aspect of the present invention, there is provided a motion estimation apparatus for calculat- 
ing a motion vector to estimate a current picture partially forming a video sequence on the basis of first and second ref- 
erence pictures partially forming the video sequence. The current picture is partially formed by a current block including 
a plurality of pels represented by pel data sets, respectively. The first reference picture is formed by reference blocks 

5 each equal in size to the current block. Each of the reference blocks of the first reference picture includes a plurality of 
pels represented by pel data sets, respectively. The second reference picture is formed by reference blocks each equal 
in size to the current block. Each of the reference blocks of the second reference picture includes a plurality of pels rep- 
resented by pel data sets, respectively. The motion vector is indicative of a displacement between the current block and 
one of the reference blocks of the second reference picture. The apparatus comprises block specifying means for spec- 

w ifying a reference block similar to the current block from among the reference blocks of the first reference picture provi- 
sional template block obtaining means for obtaining a provisional template block by multiplying each pel data set of the 
specified reference block by a first coefficient and by subtracting the multiplied pel data sets of the specified reference 
block from the pel data sets of the current block, respectively, and first selecting means for selecting one from the cur- 
rent block and the provisional template block and outputting the selected current block as a template block. The appa- 

15 ratus further comprises search window specifying means for specifying part or the whole of the second reference 
picture as a search window, provisional candidate block obtaining means for obtaining provisional candidate blocks by 
multiplying, by a second coefficient, each pel data set of the reference blocks included in the search window, and sec- 
ond selecting means for selecting one from a group of the reference blocks and a group of the provisional candidate 
blocks and outputting the selected reference blocks as candidate blocks. The reference blocks is selected when the cur- 

20 rent blocks are selected by the provisional template block obtaining means. The provisional candidate blocks are 
selected when the provisional template blocks are selected by the provisional template block obtaining means. The 
apparatus further comprises distortion calculating means for calculating, on the basis of the pel data sets of each of 
candidate blocks and the pel data sets of the template block, distortion values each indicative of a difference between 
each of interpolated blocks and the current block. Each of the interpolated blocks is indicative of a mean between the 

25 specified reference block of the first reference picture and each of the reference blocks of the search window. The appa- 
ratus further comprises distortion selecting means for selecting a minimum distortion value from among the distortion 
values, and motion vector calculating means for calculating the motion vector by specifying a reference block of the sec- 
ond reference picture bringing the minimum distortion value. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete appreciation of the invention and many of the attendant advantages thereof will be readily 
obtained as the same becomes better understood by reference to the following detailed description when considered 
in connection with the accompanying drawings, wherein: 

35 

FIG. 1(a) is a diagram showing a current picture including a current block; 

FIG. 1 (b) is a diagram showing a first reference picture including a reference block; 

FIG. 1(c) is a diagram showing a second reference picture including a search window; 

Fig. 2 is a block diagram showing a first embodiment of a motion estimation apparatus according to the present 
40 invention; 

FIG. 3 is a block diagram showing distortion calculating means show in FIG. 2; 
FIG. 4(a) is a diagram concretely showing the current block shown in FIG. 1 (a); 

FIG. 4(b) is a diagram concretely showing the reference block of the first reference picture shown in FIG. 1(b); 
FIG. 4(c) is a diagram concretely showing the search window of the second reference picture shown in FIG. 1(c); 
45 FIG. 5 is a diagram showing a template block; 

FIG. 6(a) is a diagram showing pels of the search window multiplied by "1/2"; 
FIG. 6(b) is diagram showing one of candidate blocks; 

FIG. 7 is a block diagram showing a timing control unit and showing signals supplied from the timing control unit to 
the distortion calculating means, distortion selecting means and the motion vector calculating means; 
so FIG. 8 is a block diagram concretely showing template block obtaining means, candidate block obtaining means 
and distortion calculating means; 

FIG. 9 is a plan view showing each of processor elements shown in FIG. 8; 
Fig. 10 is a block diagram showing the processor element shown in Fig. 9; 
FIG. 1 1 is a block diagram showing the distortion selecting means; 
55 FIG. 1 2 is a block diagram showing the motion vector calculating means; 

FIG. 13 is a timing chart showing the signals generated by the timing control unit shown in Fig. 7 and pel data sup- 
plied to the template block obtaining means and the candidate block obtaining means shown in FIG. 2; 
FIGS. 14 through 19 are diagrams showing flow of the candidate block data during initialization operation of the 
motion estimation apparatus shown in FIG. 8; 
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FIGS. 20 through 23 are diagrams showing flow of the candidate block data in periods (a) to (d), respectively, and 
local distortion values calculated in each of periods (a) to(d) by the central processor element shown in FIG. 8; 
FIG. 24 is a timing chart showing signals inputted into and outputted from the distortion selecting means shown in 
FIG. 1 1 and the motion vector calculating means shown in FIG. 12; 
5 Fig. 25 is a table for explaining the order of distortion values supplied to data input terminals of a selector shown in 

FIG. 11; 

FIG. 26 is a block diagram showing a second embodiment of the motion estimation apparatus according to the 
present invention; 

FIG. 27 is a block diagram showing each of processor elements shown in FIG. 26; 
w FIG. 28 is a diagram showing a template block obtained by template block obtaining means shown in FIG. 26; 

FIG. 29 is a block diagram showing distortion calculating means included in a third embodiment of the motion esti- 
mation apparatus according to the present invention; 

FIG. 30 is a block diagram showing the motion estimation apparatus of the second embodiment; 
FIG. 31 is a plan view showing each of processor elements shown in FIG. 30; 
15 FIG. 32 is a block diagram showing a circuit of each of the processor elements shown in FIG. 31 ; 

FIG. 33 is a block diagram showing a fourth embodiment of the motion estimation apparatus according to the 
present invention; 

FIG. 34 is a block diagram showing a circuit of each of processor elements shown in FIG. 33; 
FIG. 35 is a block diagram showing a fifth embodiment of the motion estimation apparatus according to the present 
20 invention; 

FIG. 36 is a block diagram showing a timing control unit and showing signals supplied from the timing control unit 
to first selecting means, second selecting means, distortion calculating means, distortion selecting means and the 
motion vector calculating means shown in FIG. 35; 

FIG. 37 is a block diagram showing a sixth embodiment of the estimation apparatus according to the present inven- 
ts tion; 

FIG. 38 is a block diagram showing a seventh embodiment of the estimation apparatus according to the present 
invention; 

FIG. 39 is a block diagram showing a circuit of each of processor elements shown in FIG. 38; 
FIG. 40 is a block diagram showing an eighth embodiment of the motion estimation apparatus according to the 
30 present invention; 

FIG. 41 is a block diagram showing a ninth embodiment of the motion estimation apparatus according to the 
present invention; 

FIG. 42 is a block diagram showing a circuit of each of processor elements shown in FIG. 41 ; 
FIG. 43 is a diagram for explaining a conventional basic inter-frame predicting coding method; 
35 FIG. 44 is a diagram for explaining a conventional motion compensation interframe predicting coding method; 

FIG. 45 is a diagram for explaining a motion vector calculated through the conventional motion compensation inter- 
frame predicting coding method; 

FIGS. 46(a) and 46(b) are diagrams for explaining a search window and a current block; 

FIGS. 47(a) and 47(b) are diagrams for explaining relations between a pel of a current block and a pel of each of 
40 candidate blocks corresponding in position to each other; 

FIG. 48 is a diagram for explaining half-pels interposed between adjoining integer pels; 

Fig. 49 is a diagram for explaining a conventional bi-directional predicting coding method and a conventional bi- 
directional interpolation predicting coding method; 

FIGS. 50(a) and 50(b) are diagrams for further explaining bi-directional interpolation predicting coding method; and 
45 FIG 51 is a diagram for explaining dual-prime predicting coding method. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Referring now to FIGS. 1 to 25 of the accompanying drawings, a preferred first embodiment of the motion estima- 
50 tion apparatus according to the present invention will be described hereinafter in detail. The motion estimation appara- 
tus is designed to calculate a motion vector to estimate a current picture Pa shown in FIG. 1 (a) on the basis of first and 
second reference pictures Pb and Pc shown in FIGS. 1(b) and 1(c), respectively. The current picture Pa and the first 
and second reference pictures Pb and Pc partially form a video sequence. The current picture Pa is partially formed by 
a current block 1 including a plurality of integer pels represented by pel data sets, respectively. The first reference pic- 
55 ture Pb is formed by reference blocks including a reference block 2. Each of the reference blocks of the first reference 
picture Pb is equal in size to the current block 1 and includes a plurality of integer pels represented by pel data sets, 
respectively. The second reference picture Pc is formed by reference blocks. Each of the reference blocks of the second 
reference picture Pc is equal in size to the current block Pa and includes a plurality of integer pels represented by pel 
data sets, respectively. The motion vector is indicative of a displacement between the current block 1 and a selected 
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reference block of the second reference picture Pc. The selected reference block will become apparent as the descrip- 
tion proceeds. 

The motion estimation apparatus is shown in FIG. 2 as comprising block specifying means 100, template block 
obtaining means 200a, search window specifying means 300, candidate block obtaining means 400, distortion calcu- 
lating means 1000a, distortion selecting means 500 and motion vector calculating means 600. 

The block specifying means 100 is operated to specify one most similar to the current block 1 from among the ref- 
erence blocks of the first reference picture Pb and to output integer pel data sets of the specified reference block. It is 
assumed that the specified reference block is the reference block 2 and that the pel data sets of the current block 1 and 
the reference block 2 are represented by a(m,n) and b(m,n), respectively, as shown in FIGS. 1(a) and 1(b). The speci- 
fying operation may be carried out by using of a motion compensation inter-frame predictive coding algorithm described 
hereinbefore with reference to FIGS. 45 through 47. 

The template block obtaining means 200a is operated to receive the integer pel data sets b(m,n) of the reference 
block 2 from the block specifying means 1 00 and subsequently to multiply each of the integer pel data sets b(m,n) by a 
first coefficient E. The template block obtaining means 200a is further operated to calculate a difference between each 
of the pel data sets a(m,n) of the current block 1 and each of the multiplied data sets b(m,n)xE corresponding in position 
to each other by subtracting each of the pel data sets b(m,n)xE from the each of the pel data sets a(m,n). Therefore, 
the difference is a(m t n)-b(m,n)xE . 

The search window specifying means 300 is operated to specify part or the whole of the second reference picture 
Pc as the search window. It is assumed that the specified search window is a search window denoted by reference 
numeral 3 in FIG. 3. Preferably, the search window 3 may be specified on the basts of a displacement between the cur- 
rent block 1 and the specified reference block 2. More specifically, the search window specifying means 300 is operated 
to calculate a motion vector indicative of the displacement between the current block 1 and the specified reference block 
2, and scaling the motion vector with respect to the second reference picture Pc to obtain a point on the second refer- 
ence picture Pc The search window 3 is specified so as to include and extending from the obtained point. The search 
window 3 includes part of the reference blocks of the second reference picture Pc. Each of the reference blocks 
included in the search window 3 are designated by reference numeral 3c and is represented by integer pels respectively 
having pel data sets c(x+m,y+n) . 

The candidate block obtaining means 400 is operated to receive the pel data sets c(x+m,y+n) of each of the ref- 
erence blocks 3c from the search window specifying means 300 and to multiply each of the pel data sets c(x+m,y+n) 
by a second coefficient F, for obtaining candidate blocks. This means that each of the candidate blocks has the pel data 
sets c(x+m,y+n)xF . 

The distortion calculating means 1000a is operated to calculate distortion values each indicative of a difference 
between the current block 1 and each of interpolated blocks by subtracting each pel data set a(m,n)-b(m,n)xE of the 
template block from each pel data set c(x+m,y+n)xF of each of the candidate blocks, converting the subtracted data 
sets to positive data sets, and summing up the positive data sets in one block unit for calculating distortion values each 
indicative of a difference between each of the interpolated blocks and the current block 1 . 

The distortion selecting means 500 is operated to select the minimum distortion value from among the distortion 
values calculated by the distortion calculating means 1000a. 

The motion vector calculating means 600 is operated to calculate the motion vector by specifying one of reference 
blocks 3c included in the search window 3. The specified reference block of the search window 3 defines, in cooperation 
with the specified reference block 2 of the first reference picture Pb, the interpolated block bringing the minimum distor- 
tion value selected by the distortion selecting means 500. 

AS shown in FIG. 3, the distortion calculating means 1000a comprises pel data outputting means 1020, first differ- 
ence calculating means 1031, second difference calculating means 1032, third difference calculating means 1033, 
fourth difference calculating means 1034, first converting means 1041, a second converting means 1042, a third con- 
verting means 1043, fourth converting means 1044, first distortion calculating means 1110, second distortion calculat- 
ing means 1120, third distortion calculating means 1130 and fourth distortion calculating means 1140. Before the 
functions of the means included in the distortion calculating means 1000a are explained, the candidate blocks will be 
described hereinafter in detail. In the present embodiment, the candidate blocks consist of first candidate blocks, sec- 
ond candidate blocks each vertically deviated by half-pel pitch from each of the first candidate blocks, third candidate 
blocks each horizontally deviated by half-pel pitch from each of the first candidate blocks, and fourth candidate blocks 
each diagonally deviated by half-pel pitch from each of the first candidate blocks. The first candidate blocks are formed 
by integer pels, the second, third and fourth candidate blocks are formed by half-pels interposed between two of integer 
pels adjacent to each other. The integer pels of the first candidate blocks are represented by integer pel data sets, 
respectively, the half pels of each of the second, third and fourth candidate blocks are represented by half pel data sets, 
respectively. Therefore, the distortion values consist of first distortion values based on the first candidate blocks, second 
distortion values based on the second candidate blocks, respectively, third distortion values based on the third candi- 
date blocks, respectively, and fourth distortion values based on the fourth candidate blocks, respectively. 
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The pel data outputting means 1020 is operated to receive the integer pel data sets a(m,n)-b(m,n)xE of the tem- 
plate block from the template block data calculating means 200a and the integer pel data sets c(x+m,y+n)xF of the 
first candidate block from the candidate block data calculating means 400. The pel data outputting means 1020 is fur- 
ther operated to output a pair of the integer pel data sets of the template block and the candidate block corresponding 
in position to each other to the first difference data calculating means 1031 . 

The first difference data calculating means 1031 is operated to subtract the pel data sets afm.nJ-bOn.nJxE of the 
template block from the pel data sets c(x+m,y+n)xF of each candidate block, for calculating first difference data sets 
{c(x+m,y+n)xF}- {a(m,n)-b(m,n)xE} . 

The first converting means 1041 is operated to convert the first difference data sets to positive data sets 
|{c(x+m,y+n)xF}-{a(m,n)-b(m,n)xE}| . The first distortion calculating means 11 10 is operated to calculate the sum of 
the converted first difference data sets based on each of the candidate blocks to obtain each of the first distortion val- 
ues. 

Since each of the first distortion values is indicative of a difference between each first interpolated block and the 
current block 1 , each of the first distortion values is defined by: 

AM 

D(x,y)= £ ^\\[c(x+m,y+n)xF+b(m t n)xE]'a(m t n)\\ (E1) 

m=0n=0 



The positive data summed up by the first distortion calculating means 1 1 10 is represented by: 

AM AM 

£ ^W{c{x+m,y+n)xF}-{a{m,n)-b{m,n)xE}\\ (EV) 

m=0n=0 



and transformed into data represented by: 

M-1 AM 

£ £(l[c(x+m,y+n)xF+/Xm.n)xE]-a(n%n)|| (E1 ") 

m=0 n=0 



The expression (EV) is identical with the right-hand side of the equation (E1), and as a consequence the first distortion 
values each indicative of a difference between the current block 1 and each of first interpolated blocks are calculated 
by the first distortion calculating means 1110. 

The second difference data calculating means 1032 is operated to calculate the sum of two of the first difference 
data sets {c(x+m,y+n)xF}-{a(m ( n)-b(m ( n)xE} and {c(x+m,y+1+n)xF}-{a(m,n)-b(m,n)xE} vertically deviated by half - 
pel pitch from each other and multiply the sum by 1/2 to obtain second difference data sets 
[^(x+m.y+nJxFJ^m.nJ-btm.nJxEJ+tcfx+m.y+l+nJxFJ^aCm.nJ-bfm.nJxE}]^ . 

The second converting means 1042 is operated to convert the second difference data sets to positive data sets 
|[{c(x+m t y+n)xF}-{a(m,n)-b(m,n)xE}+{c(x+m,y+1+n)xF}- {a(m,n)-b(m,n)xE}]/2| . The second distortion calculating 
means 1 1 20 is operated to calculate the sum of the converted second difference data sets based on each of the can- 
didate blocks to obtain each of the second distortion values. 

Since each of the second distortion values is indicative of a difference between each second interpolated block and 
the current block 1 , each of the second distortion values is defined by: 

D{x t y+Vz) = 

M-1 am 

£ ^D[{c(x+m,y+n)xF+c(x+m,y+1+n)xF}/2+b(rn ( rj)xE]-a(m,n)| 

m=0 n=0 



The positive data summed up by the second distortion calculating means 1 120 is represented by: 

AM 

£ J^\\{c{x+m,y+n)xF+c(x+m,y+^ + n)xF^/2-{a(m,n)-b(m,n)xE}ft (E2') 
m=0 n=0 
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and transformed into data represented by: 

M-1 AM 

£ £ II [{ c( x+ m t y+ n) x F+ c( x+ m, y+ 1 + n) x F}/2+ £>( m, n) x £]- a( m, n) || (E2") 

m=On=0 

The expression (EV) is identical with the right-hand side of the equation (E2) and as a consequence the second dis- 
tortion values each indicative of a difference between the current block 1 and each of second interpolated blocks are 
calculated by the second distortion calculating means 1 120. 

The third difference data calculating means 1033 is operated to calculate the sum of two of the first difference data 
sets {c(x+m,y+n)xF}-{a(m ( n)-b(m t n)xE} and {c(x+1+m,y+n)xF}-{a(m,n)-b(m,n)xE} horizontally deviated by half -pel 
pitch from each other and multiply the sum by 1/2 to obtain third difference data sets 
[{cCx+m.y+nJxFHatm.n^^ 

The third converting means 1043 is designed to convert the third difference data sets to positive data sets 
|[{c(x+m,y+n)xFWa(m,n)-b(m,n)xE}+{c(x+1+m,y+n)xF}- {a(m,n)-b(m,n)xE}]/2 1. The third distortion calculating 
means 1 1 30 is designed to calculate the sum of the converted third difference data sets based on each of the candidate 
blocks 6 to obtain each of the third distortion values. 

Since each of the third distortion values is indicative of a difference between each third interpolated block and the 
current block 1 , each of the third distortion values is defined by: 

0(x+ 1 /2,y)= 

M-1 AM (E3) 

£ ^||[{c(x+m,y+n)xF+c(x+1+m,y+n)xF}/2+t)(m t n)x£]-a( /77,n)j| 

m=0n=0 



The positive data summed up by the third distortion calculating means 1 130 is represented by: 

M-1 AM 

£ ^Htcfx+m.y+nJxF+cCx+l+m.y+nJxFl^^afm.^-^m.nJxE}!! (E3') 

m=0 n=0 



and transformed into data represented by: 

M-1 AM 

£ ^[|[{c(x+m,y+n)xF+c(x+1+/77,y+n)xF}/2+t?(m ( n)xE]-a( m,n)\\ (E3") 

m=0 n=0 



The expression (E3") is identical with the right-hand side of the equation (E3) and as a consequence the third distortion 
values each indicative of a difference between the current block 1 and each of the third interpolated blocks are calcu- 
lated by the third distortion calculating means 1 130. 

The fourth difference data calculating means 1034 is operated to calculate the sum of two of the third difference 
data sets [{c(x+m,y+n)xF}-{a(m,n)-b(m,n)xE}+ c(x+1+m,y+n)xF}-{a(m,n)-b(m,n)xE}]/2 and 

[^(x+m.y+l+nJxFJ-tatm.nJ-^m.nJxEJ+^x+Um.y+l+nJxFJ-tatm.n)- b(m,n)xE}]/2 vertically deviated by half-pel 
pitch from each other and multiply the sum by 1/2 to obtain fourth difference data sets 
[[{c(x+m,y+n)xF}-{a(m,n)- b(m,n)xE}+ cCx+l+m.y+nJxFl-fatm.nJ-bCm.nJxEJ^+HcCx+m.y+l+nJxFl-fa^.n)- b(m ( n) 
xE}+{c(x+1+m,y+1+n)xF}-{a(m,n)-b(m,n)xE}]/2]/2. The fourth converting means 1044 is operated to convert the 
fourth difference data sets to positive data sets lIHcfx+m.y+nJxFl^atm.nJ-btm.nJxEJ+ctx+l+m.y+n) 
xF}-{a(m,n)- b(m f n)xE}]/2+[{c(x+m,y+^ {a(m,n)-b(m,n)xE}]/2]/2| . 

The fourth distortion calculating means 1 140 is designed to calculate the sum of the converted fourth difference data 
sets based on each of the candidate blocks to obtain each of the fourth distortion values. 

Since each of the fourth distortion values is indicative of a difference between each fourth interpolated block and 
the current block 1 , each of the fourth distortion values is defined by: 
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A/M AM 

D(x+V2,y+V2) = £ £o[{c(x+m,y+n)xF+c(x+m,y+1 + n)xF 
+c(x+1+m,y+n)xF+c(x+1 + m,y+1+n)xF}/4+£>(m, n)xE]-a(m,n)n 

The positive data summed up by the fourth distortion calculating means 11 30 is represented by: 

W-1 AM 

£ £ ||{c(x+n7,y+n)xF+c(x+m,y+1+r?)xF+c(x+1+/T7,y+n)xF 
+c(x+1+n7,y+1+n)xF}/4-{a(m, n)-b(m, n)xE}\\ 

15 and transformed into data represented by: 

M-1 AM 

20 F+c( x+1 + 171, y+ 1 + n)x F}/4+ b( id, n)xE]-a( m, n) \\ 

The expression (E4") is identical with the right-hand side of the equation (E4) and as a consequence the fourth distor- 
tion values each indicative of a difference between the current block 1 and each of the fourth interpolated blocks are 

25 calculated by the fourth distortion calculating means 1 1 40. 

The aforementioned motion estimation apparatus will be described hereinafter in the concrete. The current picture 
Pa, the first reference picture Pb and the second reference picture Pc are shown in FIGS. 4(a), 4(b) and 4(c) as includ- 
ing the current block 1 , the specified reference block 2 and the search window 3, respectively, shown in the concrete. It 
is assumed in the present embodiment that both M and N are set to "2" and that both L and H are set to "4". In addition, 

30 it is assumed in the present embodiment that the first and second coefficient are set to "1/2". The integer pels of the 
current block 1 are represented by integer pel data sets indicated by a(0,0), a(0,1), a(1,0) and a(l,l), respectively, as 
shown in FIG. 4(a). The integer pels of the reference block 2 are represented by integer pel data sets indicated by 
b(0,0), b(0,1), b(1 ,0) and b(l ,1), respectively, as shown in FIG. 4(b). In this instance, the template block 4a is shown in 
FIG. 5. The integer pels of the search window 3 are represented by integer pel data sets indicated by c(0,0), c(0,1), 

35 c(0,2), c(0,3), c(1.0), c(1,1). c(1,2), c(1.3), c(2,0), c(2,1), c(2,2), c(2,3), c(3,0), c(3,1), c(3,2) and c(3,3). respectively, as 
shown in FIG. 4(c). In this case, the data sets of the search window 3 multiplied by the second coefficient F(=1/2) are 
shown within a window denoted by "3"' in FIG. 6(a) and thus each of the candidate blocks is designated by "6" in FIG. 
6(b). 

The motion estimation apparatus is shown in FIG. 7 as further comprising a timing control unit 900 provided with 
40 signal output terminals P1 to P9 through which a clock signal CK1 and control signals LD, CK2, CLE, SU, SL, Si, 
UMASK and CK3 are outputted, respectively. The clock signal CK1 and the control signals CK2, CLE, SU and SL are 
transmitted to the distortion calculating means 1000a. The control signal LD is transmitted to the distortion calculating 
means 1000a, the distortion selecting means 500 and the motion vector calculating means 600. The control signals Si 
and UMASK are transmitted to the distortion selecting means 500. The control signal CK3 is transmitted to the distor- 
ts tion selecting means 500 and the motion vector calculating means 600. 

The signals CK1, LD, CK2, CLE, SU, SL, Si, UMASK and CK3 are illustrated in FIGS. 13 and 24. The clock signal 
CK1 comprises clock pulses which not only serve as criteria of the control signals LD, CK2, CLE, SU, Si, UMASK and 
CK3 but also is used for regulation of the operations of the distortion calculating means 1000a, the distortion selecting 
means 500 and the motion vector calculating means 600. The control signal LD comprises a first pulse outputted in step 
so with the sixth clock pulse of the clock signal CK1 , and subsequent pulses outputted at a rate of one pulse per the four 
clock pulses of the clock signal CK1. Each of the pluses of the control signal LD is twice the width of that of the clock 
signal CK1 . The control signal CK2 is formed similarly to the clock signal CK1 . 

The control signal CLE comprises a first pulse outputted in step with the sixth clock pulse of the clock signal CK1 , 
and subsequent pulses outputted at a rate of one pulse per the four clock pulses of the clock signal CK1 . Each of the 
55 pluses of the control signal CLE is twice the width of that of the clock signal CK1 . The control signal SU comprises a 
first pulse outputted in step with the second clock pulse of the clock signal CK1 , and subsequent pulses outputted at a 
rate of one pulse per the four clock pulses of the clock signal CK1. Each of the pluses of the control signal SU is four 
times the width of that of the clock signal CK1 . The control signal SL comprises a first pulse outputted in step with the 
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first clock pulse of the clock signal CK1 , and subsequent pulses outputted at a rate of one pulse per the two clock pulses 
of the clock signal CK1 . Each of the pluses of the control signal SL is twice the width of that of the clock signal CK1 . 

The control signal Si comprises count signals represented by "0" to "9". The count signals consist of a first count 
signal outputted in step with the eleventh clock pulse of the clock signal CK1, and subsequent count signals outputted 
in step with the pulse of the control signal CK3. The control signal UMASK comprises pulses outputted in accordance 
with a predetermined internal pattern to restrict the candidate blocks 6 to be compared with one another. 

The control signal CK3 comprises a first pulse outputted in step with the first clock pulse of the clock signal CK1 , 
and subsequent pulses outputted at a rate of ten pulses per the one clock pulse of the deck signal CK1 . Each of the 
pluses of the control signal CK3 is 1/10 times the width of that of the clock signal CK1 . 

The template block obtaining means 200a is shown in FIG. 8 as comprising a multiplier 210 and a subtracter 220. 
The multiplier 210 has a data input terminal and a data output terminal. The multiplier 210 is designed to multiply data 
on the data input terminal by the first coefficient "1/2" and output the multiplied data through the data output terminal. 
The subtracter 220 has a first data input terminal A, a second data input terminal B and a data output terminal. The sub- 
tracter 220 is adapted to subtract data on the first data input terminal A from data on the second data input terminal B 
and output the subtracted data through the data output terminal. The data input terminal of the multiplier 210 is electri- 
cally connected to the data output terminal of the block data outputting means 100. The first data input terminal A of the 
subtracter 220 is electrically connected to the data output terminal of the multiplier 210, while the second data input ter- 
minal B of the subtracter 220 is electrically connected to a data output terminal (not shown) of the current block data 
outputting means. 

The pel data sets b(0,0), b(0,1), b(1 ,1 ) and b(1 ,0) are received in described order by the data input terminal of the 
multiplier 210 from the block specifying means 100. The multiplied data sets b(0.0)/2, b(0,1)/2, b(1,1)/2 and b(1,0)/2 are 
received in described order by the first data input terminal A of the subtracter 220 from the multiplier 210, while the pel 
data sets a(0,0), a(0,1), a(l,1) and a(1 ,0) are received in described order by the second data input terminal B of the 
subtracter 220 from the current block data outputting means. 

In step with the pulses of the clock signal CK1 in the periods (g) to 0) as shown in Fig. 13, the subtracted data sets 
a(0,0)-b(0,0)/2, a(0,1)-b(0,1)/2, a(1 ,1)-b(1 ,l)/2 and a(1,0)-b(1 ,0)/2 are outputted in described order through the data 
output terminal of the subtracter 220. 

The candidate block obtaining means 400 is shown in FIG. 8 as comprising a pair of multipliers 41 1 and 412. Each 
of the multipliers 41 1 and 412 has a data input terminal and a data output terminal. Each of the multipliers 41 1 and 412 
is designed to multiply data on the data input terminal by the second coefficient "1/2" and outputs the multiplied data 
through the data output terminal. The data input terminals of the multipliers 41 1 and 412 are electrically connected to 
data output terminals (not shown), respectively, of the search window specifying means 300. 

The pel data sets c(0,1), c(0,0), c(1,0), c(1,1). c(2,1), c(2,0), c(3,0) and c(3,1) are received in described order by 
the data input terminal of the multiplier 41 1 from the search window specifying means 300. In step with the pulse of the 
clock signal CK1 in the periods (a) to (h) shown in FIG. 13, the pel data sets c(0.1)/2, c(0,0)/2, c(1,0)/2, c(1,l)/2, 
c(2, 1 )/2, c(2,0)/2. c(3,0)/2 and c(3, 1 )/2 are outputted in described order through the data output terminal of the multiplier 
411. 

The pel data sets c(0,3), c(0.2). c(1,2), c(1,3), c(2,3), c(2,2), c(3,2) and c(3,3) are received in described order by 
the data input terminal of the multiplier 412 from the search window specifying means 300. 

In step with the pulses of the clock signal CK1 in the periods (a) to (h) as shown in FIG. 13, the pel data sets 
c(0,3)/2, c(0,2)/2, c(1 ,2)/2, c(1 ,3)/2, c(2,3)/2, c(2,2)/2, c(3,2)/2 and c(3,3)/2 are outputted in described order through the 
data output terminal of the multiplier 412. 

Returning back to FIG. 8, the distortion calculating means 1000a comprises nine processor elements PE1a(0,0), 
PE1a(0,1), PE1a(0,2), PE1a(1.0), PE1a(1,1). PE1a(1,2), PE1a(2,0). PE1a(2,1). PE1a(2.2) and eleven shift registers 
RE(0,-1), RE(1,-1). RE(2,-1), RE(3,-1), RE(3,0), RE(3,1), RE(3.2), RE(0,3). RE(1.3) ( RE(2,3). RE(3.3). Each of the 
processor elements PE is indicated by PE1a(x, y) and each of the shift register RE is indicated by RE(x.y), where x is 
represented by "0", "1", "2", "3" and y is represented by "-1", "0", "1", "2", "3". FIG. 9 is a plan view of each of the proc- 
essor element PE1a(x,y). In FIG. 9, each of the processor elements PE1a(x,y) has data input terminals X YDi, YLi, HLi, 
Dli, DHi, DVi, DDi, HXi, HUi and YUi, data output terminals YUo, HUo, HXo, YDo, DDo, DVo, DHo, Dlo, HLo and YLo, 
signal input terminals (not shown) and signal output terminals (not shown). 

Each of the processor elements PE1a(x,y) is shown in FIG. 10 as comprising a selector 1301 , a D flip-flop 1302, a 
subtracter 1303, a positive value transducer 1305. an adder 1306, a D flip-flop 1307, a selector 1308 and a D flip-flop 
1309. 

The selector 1301 has a first data input terminal A, a second data input terminal B, a third data input terminal C, 
first and second signal input terminals SO and S1 , and a data output terminal Y. When the first and second signal input 
terminals SO and S1 of the selector 1301 receive signals representative of "0" and "0", respectively, data on the first data 
input terminal A of the selector 1 301 are selected and outputted through the data output terminal Y of the selector 1 301 . 
When the first and second signal input terminals SO and S1 of the selector 1301 receive signals representative of "1" 
and "0", respectively, data on the second data input terminal B of the selector 1301 are selected and outputted through 
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the data output terminal Y of the selector 1 301 . When the first and second signal input terminals SO and S1 of the selec- 
tor 1301 receive signals representative of "0" and "1" or "1" and "1", respectively, data on the third data input terminal 
C of the selector 1301 are selected and outputted through the data output terminal Y of the selector 1301 . 

The D flip-flop 1302 has data input terminal, a signal input terminal 1302a and a data output terminal. When the D 

5 flip-flop 1302 detects a rising edge of a pulse received by the signal input terminal 1302a, i.e., when a signal received 
by the signal input terminal 1302a of the D flip-flop 1302 is changed "0" to "1", the D flip-flop 1302 latches, on the data 
output terminal, data received at that time by the data input terminal. The subtracter 1303 has a first data input terminal 
A, a second data input terminal B and a data output terminal . The subtracter 1 303 is adapted to subtract data received 
by the second data input terminal B from data received by the first data input terminal A and output the subtracted data 

10 through the data output terminal. 

The positive value transducer 1305 has a data input terminal and a data output terminal. The positive value trans- 
ducer 1305 is an absolute value transducer or a square multiplier. If the positive value transducer 1305 is the absolute 
value transducer, the positive value transducer 1305 converts data on the data input terminal to positive value data by 
means of absolute value arithmetic and outputs the converted data through the data output terminal. If the positive 

is value transducer 1305 is the square multiplier, the positive value transducer 1305 converts data on the data input ter- 
minal to positive value data by means of square arithmetic and outputs the converted data through the data output ter- 
minal. The adder 1306 has a first data input terminal A, a second data input terminal B and a data output terminal. The 
adder 1306 is designed to add data on the second data input terminal B to data on the first data input terminal A and 
output the added data through the data output terminal. 

20 The D flip-flop 1307 has a data input terminal, a first signal input terminal 1307a, a second signal input terminal 
1307b and a data output terminal. When the D flip-flop 1307 detects a low-to-high transition of a signal received by the 
first signal input terminal 1307a, the D flip-flop latches, on the data output terminal, data received at that time by the 
data input terminal. When the D flip-flop 1307 detects a low-to-high transition of a signal received by the second signal 
input terminal 1 307b, the D flip-flop 1307 resets data on the data output terminal to "0". 

25 The selector 1 308 has a first data input terminal A, a second data input terminal B, a signal input terminal S and a 
data output terminal Y When the signal input terminal S of the selector 1308 receives a signal representative of "0", 
data on the first data input terminal A of the selector 1308 are selected and outputted through the data output terminal 
Y of the selector 1308. When the signal input terminal S of the selector 1308 receives a signal representative of "1", 
data on the second data input terminal B of the selector 1308 are selected and outputted through the data output ter- 

30 minal Y of the selector 1308. The D flip-flop 1309 has a data input terminal, a signal input terminal 1309a and a data 
output terminal. When the D flip-flop 1309 detects a rising edge of a pulse received by the signal input terminal 1309a, 
the D flip-flop 1309 latches, on the data output terminal, data received at that time by the data input terminal. 

The first data input terminal A of the selector 1301 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1 302 of the upper side processor element PE(x,y-1) through the data 

35 input terminal YDi of the present processor element PE1 a(x,y) and the data output terminal YDo of the upper side proc- 
essor element PE1a(x,y-1). If there is no upper side processor element PE1a(x,y-1), the first data input terminal A of 
the selector 1301 of the present processor element PE1a(x,y) is electrically connected to a data output terminal of the 
upper side shift register RE(x,y-1) through the data input terminal YDi of the present processor element PE1 a(x,y). The 
second data input terminal B of the selector 1301 of the present processor element PE1a(x,y) is electrically connected 

40 to the data output terminal of the lower side processor element PE1a(x,y+1) through the data input terminal YUi of the 
present processor element PE1a(x,y) and the data output terminal YUo of the lower side processor element 
PE1a(x,y+1). If there is no lower side processor element PE1a(x,y+1), the second data input terminal B of the selector 
1301 of the present processor element PE1a(x,y) is electrically connected to the data output terminal of the lower side 
shift register RE(x,y+1) through the data input terminal YUi of the present processor element PE1a(x,y). The third data 

45 input terminal C of the selector 1301 of the present processor element PE1a(x,y) is electrically connected to the data 
output terminal of the right side processor element PE1 a(x+1 ,y) through the data input terminal YLi of the present proc- 
essor element PE1a(x,y) and the data output terminal YLo of the right side processor element PE1a(x+1 ,y). If there is 
no right side processor element PE1a(x+1,y), the third data input terminal C of the selector 1301 of the present proc- 
essor element PE1a(x,y) is electrically connected to a data output terminal of the right side shift register RE(x+1,y) 

so through the data input terminal YLi of the present processor element PE1a(x,y). 

The first signal input terminal SO of the selector 1301 of the present processor element PE1a(x,y) is electrically 
connected to the signal output terminal of the timing control unit 900 to receive the control signal SU, while the second 
signal input terminal S1 of the selector 1301 of the present processor element PE1a(x,y) is electrically connected to the 
signal output terminal of the timing control unit 900 to receive the control signal SL 

55 The data input terminal of the D flip-flop 1 302 of the present processor element PE 1 a(x,y) is electrically connected 
to the data output terminal Y of the selector 1301 of the present processor element PE1a(x,y). The signal input terminal 
1302a of the D flip-flop 1302 of the present processor element PE1a(x,y) is electrically connected to the signal output 
terminal of the timing control unit 900 to receive the clock signal CK1 . 
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The first data input terminal A of the subtracter 1 303 of the present processor element PE 1 a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1302 of the present processor element PE1a(x,y), while the second 
data input terminal 8 of the subtracter 1303 of the present processor element PE1a(x, y) is electrically connected to the 
data output terminal of the template block obtaining means 200 through the data input terminal X of the present proc- 

s essor element PE1a(x,y). 

The data input terminal of the positive value transducer 1305 of the present processor element PE1a(x,y) is elec- 
trically connected to the data output terminal of the subtracter 1303 of the present processor element PE1a(x,y). The 
first input terminal A of the adder 1306 of the present processor element PE1a(x,y) is electrically connected to the data 
output terminal of the positive value transducer 1305 of the present processor element PE1a(x,y), while the second 

w input terminal B of the adder 1 306 of the present processor element PE1 a(x, y) is electrically connected to the data out- 
put terminal of the D flip-flop 1307 of the present processor element PE1 a(x,y). The data input terminal of the D flip-flop 
1 307 of the present processor element PE1 a(x,y) is electrically connected to the data output terminal of the adder 1 306 
of the present processor element PE1a(x,y). The first signal input terminal 1307a of the D flip-flop 1307 is electrically 
connected to the signal output terminal of the timing control unit 900 to receive the clock signal CK1 , while the second 

is signal input terminal 1307b of the D flip-flop 1307 is electrically connected to the signal output terminal of the timing 
control unit 900 to receive the control signal CLE. 

The first data input terminal A of the selector 1308 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1309 of the right side processor element PE1a(x+1 ,y) through the 
data input terminal Dli of the present processor element PE1a(x,y) and the data output terminal Dlo of the right side 

20 processor element PE1a(x+1 ,y), while the second data input terminal B of the selector 1308 of the present processor 
element PE1a(x,y) is electrically connected to the data output terminal of the D flip-flop 1307 of the present processor 
element PE1a(x,y). The signal input terminal S of the selector 1 308 of the present processor element PE1 a(x,y) is elec- 
trically connected to the signal output terminal of the timing control unit 900 to receive the control signal LD. The data 
input terminal of the D flip-flop 1309 is electrically connected to the data output terminal Y of the selector 1308. The 

25 signal input terminal 1309a of the D flip-flop 1309 is electrically connected to the signal output terminal of the timing 
control unit 900 to receive the control signal CK2. 

Each of the processor elements PE1a(x,y) further comprises an adder 1313, a multiplier 1314, a positive value 
transducer 1315, an adder 1316, a D flip-flop 1317, a selector 1318 and a D flip-flop 1319. The adder 1313 has a first 
data input terminal A, a second data input terminal B and a data output terminal. The adder 1313 is designed to add 

30 data on the second data input terminal B to data on the first data input terminal A and output the added data through 
the data output terminal. 

The multiplier 1 3 1 4 has a data input terminal and a data output terminal. The multiplier 1 3 1 4 is designed to multiply 
data on the data input terminal by "1/2" and outputs the multiplied data through the data output terminal. Similarly to the 
positive value transducer 1 305, the positive value transducer 1 31 5 has a data input terminal and a data output terminal. 

35 The positive value transducer 1315 is an absolute value transducer or a square multiplier. If the positive value trans- 
ducer 1 31 5 is the absolute value transducer, the positive value transducer 1315 converts data on the data input terminal 
to positive value data by means of absolute value arithmetic and outputs the converted data through the data output 
terminal. If the positive value transducer 1315 is the square multiplier, the positive value transducer 1315 converts data 
on the data input terminal to positive value data by means of square arithmetic and outputs the converted data through 

40 the data output terminal. 

Similarly to the adder 1306, the adder 1316 has a first data input terminal A, a second input terminal B and a data 
output terminal. The adder 1316 is designed to add data on the second data input terminal B to data on the first data 
input terminal A and output the added data through the data output terminal. 

Similarly to the D flip-flop 1307, the D flip-flop 1317 has a data input terminal, a first signal input terminal 1317a, a 

45 second signal input terminal 1 31 7b and a data output terminal. When the D flip-flop 1317 detects a low-to-high transi- 
tion of a signal received by the first signal input terminal 1 3 1 7a, the D flip-flop 1317 latches, on the data output terminal, 
data received at that time by the data input terminal. When the D flip-flop 1317 detects a tow-to-high transition of a sig- 
nal received by the second signal input terminal 1317b, the D flip-flop 1317 resets data on the data output terminal to 
"0". 

so Similarly to the selector 1308, the selector 1318 has a first data input terminal A, a second data input terminal B, a 
signal input terminal S and a data output terminal Y. When the signal input terminal S of the selector 1318 receives a 
signal representative of "0", data on the first data input terminal A of the selector 1318 are selected and outputted 
through the data output terminal Yof the selector 1318. When the signal input terminal S of the selector 1318receives 
a signal representative of "1", data on the second data input terminal B of the selector 1318 are selected and outputted 

55 through the data output terminal Y of the selector 1318. Similarly to the D flip-flop 1309, the D flip-flop 1319 has data 
input terminal, a signal input terminal 131 9a and a data output terminal. When the D flip-flop 1319 detects a rising edge 
of a pulse received by the signal input terminal 1319a, the D flip-flop 1319 latches, on the data output terminal, data 
received at that time by the data input terminal. 
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The first data input terminal A of the adder 1313 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the subtracter 1303 of the present processor element PE1a(x,y). The second data 
input terminal B of the adder 1 31 3 of the present processor element PE1 a(x,y) is electrically connected to the data out- 
put terminal of the subtracter 1 303 of the lower side processor element P£1a(x,y+1) through the data input terminal HUi 

5 of the present processor element PE1a(x,y) and the data output terminal HUo of the lower side processor element 
PE1a(x,y+1). If there is no lower side processor element PE1a(x,y+1), the second data input terminal B of the subtract 
1313 of the present processor element PE1a(x,y) is electrically connected to the data output terminal of the lower side 
shift register RE(x,y+1) through the data input terminal HUi of the present processor element PE1a(x,y). 

The data input terminal of the multiplier 1314 of the present processor element PE1a(x,y) is electrically connected 

w to the data output terminal of the adder 1313 of the present processor element PE1a(x,y). The data input terminal of 
the positive value transducer 1 31 5 of the present processor element PE 1 a(x,y) is electrically connected to the data out- 
put terminal of the multiplier 1314 of the present processor element PE1a(x,y). 

The first data input terminal A of the adder 1316 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the positive value transducer 1315 of the present processor element PE1a(x,y), 

75 while the second data input terminal Bof the adder 1316 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1317 of the present processor element PE1a(x,y). 

The data input terminal of the D flip-flop 131 7 of the present processor element PE1a(x,y) is electrically connected 
to the data output terminal of the adder 1316 of the present processor element PE1a(x,y). The first signal input terminal 
1317a of the D flip-flop 1317 of the present processor element PE1a(x,y) is electrically connected to the signal output 

20 terminal of the timing control unit 900 to receive the clock signal CK1 , while the second signal input terminal 131 7b of 
the D flip-flop 1317 of the present processor element PE1a(x ( y) is electrically connected to timing control unit 900 to 
receive the control signal CLE. 

The first data input terminal A of the selector 1318 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1319 of the right side processor element PE1a(x+1,y) through the 

25 data input terminal DVi of the present processor element PE1a(x,y) and the data output terminal DVo of the right side 
processor element PE1a(x+1,y), while the second data input terminal B of the selector 1318 of the present processor 
element PE1a(x,y) is electrically connected to the data output terminal of the D flip-flop 1317 of the present processor 
element PE1a(x,y). The signal input terminal Sof the selector 1318 of the present processor element PE1a(x,y) is elec- 
trically connected to the signal output terminal of the timing control unit 900 to receive the control signal LD. 

30 The data input terminal of the D flip-flop 1319 of the present processor element PE1a(x,y) is electrically connected 
to the data output terminal Y of the selector 1 31 8 of the present processor element PE1a(x,y). The signal input terminal 
1319a of the D flip-flop 1319 of the present processor element PE1a(x,y) is electrically connected to the signal output 
terminal of the timing control unit 900 to receive the control signal CK2. 

Each of the processor elements PE1a(x,y) further comprises an adder 1323, a multiplier 1324, a positive value 

35 transducer 1325, an adder 1326, a D flip-flop 1327, a selector 1328 and a D flip-flop 1329. 

Similarly to the adder 1313, the adder 1323 has a first data input terminal A, a second data input terminal B and a 
data output terminal. The adder 1323 is designed to add data on the second data input terminal B to data on the first 
data input terminal A and output the added data through the data output terminal. 

Similarly to the multiplier 1314, the multiplier 1324 has a data input terminal and a data output terminal. The multi- 

40 plier 1324 is designed to multiply data on the data input terminal by "1/2" and outputs the multiplied data through the 
data output terminal. Similarly to the positive value transducer 1315, the positive value transducer 1 325 has a data input 
terminal and a data output terminal. The positive value transducer 1325 is an absolute value transducer or a square 
multiplier. 

If the positive value transducer 1325 is the absolute value transducer, the positive value transducer 1325 converts 
45 data on the data input terminal to positive value data by means of absolute value arithmetic and outputs the converted 
data through the data output terminal. If the positive value transducer 1325 is the square multiplier, the positive value 
transducer 1 325 converts data on the data input terminal to positive value data by means of square arithmetic and out- 
puts the converted data through the data output terminal. 

Similarly to the adder 1316, the adder 1326 has a first data input terminal A, a second input terminal B and a data 
so output terminal. The adder 1326 is designed to add data on the second data input terminal B to data on the first data 
input terminal A and output the added data through the data output terminal. 

Similarly to the D flip-flop 1317, the D flip-flop1327 has a data input terminal, a first signal input terminal 1327a, a 
second signal input terminal 1327b and a data output terminal. When the D flip-flop 1327 detects a low-to-high transi- 
tion of a signal received by the first signal input terminal 1 327a, the D flip-flop 1 327 latches, on the data output terminal, 
55 data received at that time by the data input terminal. When the D flip-flop 1 327 detects a low-to-high transition of a sig- 
nal received by the second signal input terminal 1327b, the D flip-flop 1327 resets data on the data output terminal to 
"0". 

Similarly to the selector 1318, the selector 1328 has a first data input terminal A, a second data input terminal B, a 
signal input terminal S and a data output terminal Y. When the signal input terminal S of the selector 1328 receives a 
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signal representative of "0", data on the first data input terminal A of the selector 1328 are selected and outputted 
through the data output terminal Y of the selector 1328. When the signal input terminal S of the selector 1328 receives 
a signal representative of "1", data on the second data input terminal B of the selector 1 328 are selected and outputted 
through the data output terminal Y of the selector 1328. Similarly to the D flip-flop 1319, the D flip-flop 1329 has data 
5 input terminal, a signal input terminal 1 329a and a data output terminal. When the D flip-flop 1 329 detects a rising edge 
of a pulse received by the signal input terminal 1329a, the D flip-flop 1329 latches, on the data output terminal, data 
received at that time by the data input terminal. 

The first data input terminal A of the adder 1323 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the subtracter 1303 of the present processor element PE1 a(x t y), while the second 
w data input terminal B of the adder 1323 of the present processor element PE1a(x,y) is electrically connected to the data 
output terminal of the subtracter 1303 of the right side processor element PE1a(x+1 ,y) through the data input terminal 
HLi of the present processor element PE1a(x,y) and the data output terminal HLo of the right side processor element 
PE(x+1 , y). If there is no right side processor element PE1a(x+1 ,y), the second data input terminal B of the adder 1323 
is electrically connected to the data output terminal of the right side shift register RE(x+1 ,y) through the data input ter- 
15 minal HLi of the present processor element PE1a(x,y). 

The data input terminal of the multiplier 1324 of the present processor element PE1a(x,y) is electrically connected 
to the data output terminal of the adder 1323 of the present processor element PE1a(x, y). The data input terminal of 
the positive value transducer 1 325 of the present processor element PE 1 a(x, y) is electrically connected to the data out- 
put terminal of the multiplier 1324 of the present processor element PE1a(x, y). 
20 The first data input terminal A of the adder 1326 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the positive value transducer 1325 of the present processor element PE1a(x,y), 
while the second data input terminal B of the adder 1326 of the present processor element PE1 a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1 327 of the present processor element PE1 a(x,y). 

The data input terminal of the D flip-flop 1327 of the present processor element PE1a(x,y) is electrically connected 
25 to the data output terminal of the adder 1 326 of the present processor element PE1 a(x,y). The first signal input terminal 
1327a of the D flip-flop 1327 of the present processor element PE1a(x,y) is electrically connected to the signal output 
terminal of the timing control unit 900 to receive the clock signal CK1 , while the second signal input terminal 1327b of 
the D flip-flop 1 327 of the present processor element PE1 a(x,y) is electrically connected to the signal output terminal of 
the timing control unit 900 to receive the control signal CLE. 
30 The first data input terminal A of the selector 1 328 of the present processor element PE1 a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1329 of the right side processor element PE1a(x+1 ,y) through the 
data input terminal DHi of the present processor element PE1a(x,y) and the data output terminal DHo of the right side 
processor element PE1a(x+1 ,y), while the second data input terminal B of the selector 1328 of the present processor 
element PE1a(x,y) is electrically connected to the data output terminal of the D flip-flop 1327 of the present processor 
35 element PE1a(x,y). The signal input terminal S of the selector 1328 of the present processor element PE1a(x,y) is elec- 
trically connected to the signal output terminal of the timing control unit 900 to receive the control signal LD. 

The data input terminal of the D flip-flop 1 329 of the present processor element PE1 a(x,y) is electrically connected 
to the data output terminal Y of the selector 1 328 of the present processor element PE1 a(x,y). The signal input terminal 
1329a of the D flip-flop 1329 of the present processor element PE1a(x,y) is electrically connected to the signal output 
40 terminal of the timing control unit 900 to receive the control signal CK2. 

Each of the processor elements PE1a(x,y) further comprises an adder 1333, a multiplier 1334, a positive value 
transducer 1335, an adder 1336, a D flip-flop 1337, a selector 1338 and a D flip-flop 1339. 

Similarly to the adder 1313, the adder 1333 has a first data input terminal A, a second data input terminal B and a 
data output terminal. The adder 1333 is designed to add data on the second data input terminal B to data on the first 
45 data input terminal A and output the added data through the data output terminal. 

Similarly to the multiplier 1314, the multiplier 1334 has a data input terminal and a data output terminal. The multi- 
plier 1334 is designed to multiply data on the data input terminal by "1/2" and outputs the multiplied data through the 
data output terminal. Similarly to the positive value transducer 1315, the positive value transducer! 335 has a data input 
terminal and a data output terminal. The positive value transducer 1335 is an absolute value transducer or a square 
so multiplier. If the positive value transducer 1 335 is the absolute value transducer, the positive value transducer 1 335 con- 
verts data on the data input terminal to positive value data by means of absolute value arithmetic and outputs the con- 
verted data through the data output terminal. If the positive value transducer 1335 is the square multiplier, the positive 
value transducer 1335 converts data on the data input terminal to positive value data by means of square arithmetic 
and outputs the converted data through the data output terminal. 
55 Similarly to the adder 1 31 6, the adder 1 336 has a first data input terminal A, a second input terminal B and a data 
output terminal. The adder 1336 is designed to add data on the second data input terminal B to data on the first data 
input terminal A and output the added data through the data output terminal. 

Similarly to the D flip-flop 131 7, the D flip-flop 1337 has a data input terminal, a first signal input terminal 1337a, a 
second signal input terminal 1337b and a data output terminal. When the D flip-flop 1337 detects a low-to-high transi- 
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tion of a signal received by the first signal input terminal 1337a, the D flip-flop 1 337 latches, on the data output terminal, 
data received at that time by the data input terminal. When the D flip-flop 1337 detects a low-to-high transition of a sig- 
nal received by the second signal input terminal 1337b, the D flip-flop 1337 resets data on the data output terminal to 

"0". 

5 Similarly to the selector 1318, the selector 1338 has a first data input terminal A, a second data input terminal B, a 

signal input terminal S and a data output terminal Y When the signal input terminal S of the selector 1338 receives a 
signal representative of "0", data on the first data input terminal A of the selector 1338 are selected and outputted 
through the data output terminal Y of the selector 1338. When the signal input terminal S of the selector 1338 receives 
a signal representative of "1", data on the second data input terminal B of the selector 1 338 are selected and outputted 

10 through the data output terminal Y of the selector 1338. 

Similarly to the D flip-flop 1319, the D flip-flop 1339 has data input terminal, a signal input terminal 1339a and a 
data output terminal. When the D flip-flop 1339 detects a rising edge of a pulse received by the signal input terminal 
1339a, the D flip-flop 1339 latches, on the data output terminal, data received at that time by the data input terminal. 
The first data input terminal A of the adder 1333 of the present processor element PE1a(x,y) is electrically con- 

15 nected to the data output terminal of the multiplier 1324 of the lower side processor element PE1a(x,y+1) through the 
data input terminal HXi of the present processor element PE1a(x,y) and the data output terminal HXo of the lower side 
processor element PE1a(x,y+1). If there is no lower side processor element PE1a(x,y+1), the first data input terminal 
A of the adder 1 333 of the present processor element PE1 a(x,y) is electrically connected to the data output terminal of 
the lower side shift register RE(x, y+1 ) through the data input terminal HXi of the present processor element PE1a(x,y). 

20 The second data input terminal B of the adder 1333 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the multiplier 1324 of the present processor element PE1a(x,y). 

The data input terminal of the multiplier 1334 of the present processor element PE1a(x,y) is electrically connected 
to the data output terminal of the adder 1333 of the present processor element PE1a(x,y). The data input terminal of 
the positive value transducer 1335 of the present processor element PE1a(x,y) is electrically connected to the data out- 

25 put terminal of the multiplier 1 334 of the present processor element PE1 a(x,y). 

The first data input terminal A of the adder 1336 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the positive value transducer 1335 of the present processor element PE1a(x,y), 
while the second data input terminal B of the adder 1336 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1337 of the present processor element PE1a(x,y). 

30 The data input terminal of the D flip-flop 1337 of the present processor element PE1a(x,y) is electrically connected 
to the data output terminal of the adder 1336 of the present processor element PE1 a(x,y). The first signal input terminal 
1337a of the D flip-flop 1337 of the present processor element PE1a(x,y) is electrically connected to the signal output 
terminal of the timing control unit 900 to receive the clock signal CK1 , while the second signal input terminal 1337b of 
the D flip-flop 1337 of the present processor element PE1a(x,y) is electrically connected to the signal output terminal of 

35 the timing control unit 900 to receive the control signal CLE. 

The first data input terminal A of the selector 1 338 of the present processor element PE1a(x,y) is electrically con- 
nected to the data output terminal of the D flip-flop 1339 of the right side processor element PE1a(x+1,y) through the 
data input terminal DHi of the present processor element PE1a(x,y) and the data output terminal DHo of the right side 
processor element PE1a(x+1,y), while the second data input terminal B of the selector 1338 of the present processor 

40 element PE1 a(x,y) is electrically connected to the data output terminal of the D flip-flop 1337 of the present processor 
element PE1a(x,y). The signal input terminal S of the selector 1338 of the present processor element PE1a(x,y) is elec- 
trically connected to the signal output terminal of the timing control unit 900 to receive the control signal LD. 

The data input terminal of the D flip-flop 1339 of the present processor element PE1a(x,y) is electrically connected 
to the data output terminal Y of the selector 1338 of the present processor element PE1a(x,y). The signal input terminal 

45 1339a of the D flip-flop 1339 of the present processor element PE1a(x,y) is electrically connected to the signal output 
terminal of the timing control unit 900 to receive the control signal CK2. 

Referring to Fig. 8, when the pulses of the clock signal CK1 are received, the shift registers RE(3,0) and RE(3,2) 
receive the pel data from the candidate block obtaining means 400. When the (4n-2)th pulses of the clock signal CK1 
are received, the shift register RE(3,1) receives the pel data from the shift register RE(3,0) while the shift register 

so RE(3,3) receives the pel data from the shift register RE(3.2). When the 4nth pulses of the clock signal CK1 are received, 
the shift register RE(3,-1) receives the pel data from the shift register RE(3,0) while the shift register RE(3,1) receives 
the pel data from the shift register RE(3,2). 

When the 4nth pulses of the clock signal CK1 are received, the shift register RE(2,-1) receives the pel data from 
the shift register RE(2,0). In step with the (4n ± 1 )th pulses of the clock signal CK1 are received, the shift register RE(2, 

55 -1) receives the pel data from the shift register RE(3, -1). 

When the (4n ± 1)th pulses of the clock signal CK1 are received, the shift register RE(2, 3) receives the pel data 
from the shift register RE(3, 3). When the (4n+2)th pulses of the clock signal CK1 are received, the shift register RE(2, 
3) receives the pel data from the processor element PE1a (2,2). 
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When the (4n ± 1)th pulses of the clock signal CK1 are received, the shift register RE(1 ,-1) receives the pel data 
from the shift register RE(2,-1). When the 4nth pulses of the clock signal CK1 are received, the shift register RE(1 ,-1) 
receives the pel data from the processor element PE1a(1,0). When the (4n+2)th pulses of the clock signal CK1 are 
received, the shift register RE(1,3) receives the pel data from the processor element PE1a (1,2). When the (4n ± 1)th 
pulses of the clock signal CK1 are received, the shift register RE(1,3) receives the pel data from the shift register 
RE(2,3). 

When the 4nth pulses of the clock signal CK1 are received, the shift register RE(0,-1) receives the pel data from 
the processor element PE1a(0,0). When the (4n ± 1)th pulses of the clock signal CK1 are received, the shift register 
RE(0,-1) receives the pel data from the shift register RE(1 ,-1). 

When the (4n ± 1)th pulses of the clock signal CK1 are received, the shift register RE(0,3) receives the pel data 
from the shift register RE(1 ,3). When the (4n+2)th pulses of the clock signal CK1 are received, the shift register RE(0. 
3) receives the pel data from the processor element PEta(0, 2). 

The distortion specifying means 500 is shown in FIG. 1 1 as comprising a selector 51 0, a comparator 530, a logical 
product element 531 , a selector 540 and a flip-flop 550. The selector 510 has data input terminals I0-I9, a signal input 
terminal S, and a data output terminal Y. The data input terminal 10 is electrically connected to the data output terminal 
of the flip-flop 1309 of the processor element PE1a(0,0) through the output terminal Dlo of the processor element 
PE1a(0,0). The signal input terminal S of the selector 510 is electrically connected to the output terminal P7 of the tim- 
ing control unit 900. 

The data input terminal 11 is electrically connected to the data output terminal of the flip-flop 1319 of the processor 
element PEla(0,0) through the output terminal DVo of the processor element PEla(0,0). 

The data input terminal 12 is electrically connected to the data output terminal of the flip-flop 1 309 of the processor 
element PE1a(0,1) through the output terminal Dlo of the processor element PE1a(0,1). The data input terminal 13 is 
electrically connected to the data output terminal of the flip-flop 1319 of the processor element PEla(0,l) through the 
output terminal DVo of the processor element PE1a(0, 1). 

The data input terminal 14 is electrically connected to the data output terminal of the flip-flop 1309 of the processor 
element PE1a(0,2) through the output terminal Dlo of the processor element PE1a(0,2). The data input terminal 15 is 
electrically connected to the data output terminal of the flip-flop 1329 of the processor element PE1a(0,0) through the 
output terminal DHo of the processor element PE1a(0,0). 

The data input terminal 16 is electrically connected to the data output terminal of the flip-flop 1 339 of the processor 
element PE1a(0,0) through the output terminal DDo of the processor element PE1a(0,0). The data input terminal 17 is 
electrically connected to the data output terminal of the flip-flop 1329 of the processor element PE1a(0, 1) through the 
output terminal DHo of the processor element PEla(0, 1). 

The data input terminal 18 is electrically connected to the data output terminal of the flip-flop 1 339 of the processor 
element PE1a(0,1) through the output terminal DDo of the processor element PE1a(0,1). The data input terminal 19 is 
electrically connected to the data output terminal of the flip-flop 1329 of the processor element PE1a(0,2) through the 
output terminal DHo of the processor element PE1a(0,2). 

The selector 510 of the distortion specifying means 500 is adapted to output a data received in the data input ter- 
minal 10 through the data output terminal Y when the signal input terminal S receives an input signal represented by "0", 
while outputting a data received in the data input terminal 11 through the data output terminal Y when the signal input 
terminal S receives an input signal represented by "1 ". The selector 51 0 is adapted to output a data received in the data 
input terminal 12 through the data output terminal Y when the signal input terminal S receives an input signal repre- 
sented by "2", while outputting a data received in the data input terminal 13 through the data output terminal Y when the 
signal input terminal S receives an input signal represented by "3". 

The selector 51 0 is adapted to output a data received in the data input terminal 14 through the data output terminal 

Y when the signal input terminal S receives an input signal represented by "4", while outputting a data received in the 
data input terminal 15 through the data output terminal Y when the signal input terminal S receives an input signal rep- 
resented by "5". 

The selector 510 is adapted to output a data received in the data input terminal 16 through the data output terminal 

Y when the signal input terminal S receives an input signal represented by "6". while outputting a data received in the 
data input terminal 17 through the data output terminal Y when the signal input terminal S receives an input signal rep- 
resented by "7". 

The selector 510 is adapted to output a data received in the data input terminal 18 through the data output terminal 

Y when the signal input terminal S receives an input signal represented by "8", while outputting a data received in the 
data input terminal 19 through the data output terminal Y when the signal input terminal S receives an input signal rep- 
resented by "9". 

The comparator 530 has a first data input terminal A, a second data input terminal B and a signal output terminal, 
and is designed to produce an output signal indicated by "0" through the signal output terminal when the first data input 
terminal A has an input data equal to and larger than that of the second data input terminal B, while producing an output 
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signal indicated by "1 " through the signal output terminal when the first data input terminal A has an input data smaller 
than that of the second data input terminal B. 

The logical product calculator 531 has a first signal input terminal A, a second signal input terminal B and a signal 
output terminal. When both the first and second signal input terminals A and B receive input signal represented by "1 ", 

5 the logical product calculator 531 outputs an output signal represented by "1 " through the signal output terminal. When, 
on the other hand, either the first and second input terminals A or B receives an input signal represented by "0", the 
logical product calculator 531 outputs an output signal represented by "0 through the signal output terminal. 

The selector 540 has a first data input terminal A, a second data input terminal B, a signal input terminal S and a 
data output terminal Y. The selector 540 is adapted to output a data received in the second data input terminal B 

10 through the data output terminal Y when the signal input terminal S receives an input signal represented by "0", while 
outputting a data received in the first data input terminal A through the data output terminal Y when the signal input ter- 
minal S receives an input signal represented by "1". 

The flip-flop 550 is constituted by D flip-flop and thus has a data input terminal, a first signal input terminal 550a, 
second signal input terminal 550b and a data output terminal. The flip-flop 550 is designed to set "1" in simultaneous 

75 timing with the pulses of the signals received through the first signal input terminal 550a. The flip-flop 550 is designed 
to latch data received through the data input terminal A in simultaneous timing with the pulses of the signals received 
through the second signal input terminal 550b. 

The data input terminal A of the comparator 530 is electrically connected to the data output terminal Y of the selec- 
tor 510. The data input terminal B of the comparator 530 is electrically connected to the data output terminal of the flip- 

20 flop 550. The first signal input terminal A of the logical product element 531 is electrically connected to the signal output 
terminal of the comparator 530. The second signal input terminal B of the logical product element 531 is electrically con- 
nected to the signal output terminal of the timing control unit to receive the control signal UMASK. The first data input 
terminal A of the selector 540 is electrically connected to the data output terminal of the selector 510. The second data 
input terminal B of the selector 540 is electrically connected to the data output terminal of the flip-flop 550. The signal 

25 input terminal S of the selector 540 is electrically connected to the signal output terminal of the logical product element 
531. 

The data input terminal of the flip-flop 550 is electrically connected to the data output terminal Y of the selector 540. 
The first signal input terminal 550a of the flip-flop 550 is electrically connected to the signal output terminal of the timing 
control unit 900 to receive the control signal LD. The second signal input terminal 550b of the flip-flop 550 is electrically 

30 connected to the signal output terminal of the timing control unit 900 to receive the control signal CK3. 

The motion vector calculating means 600 is shown in FIG. 12 as comprising quinary counters 610 and 620, and 
flip-flops 630 and 640. The quinary counter 610 has signal input terminals CK and CL, a carry input terminal CYi and a 
count output terminal Qn. The quinary counter 61 0 causes all outputs of the count output terminal Qn thereof to be set 
to "0" when the signal input terminal CL thereof receives a signal representative of "1 ". After all output of the count out- 

35 put terminal Qn of the quinary counter 610 are set to "0", the quinary counter 610 counts up from "0" in step with the 
carry signal received by the carry input terminal CYi to output, through the count output terminal Qn, the count number 
that reverts to "0" in the sequence of counting alter reaching a maximum value of "4". The outputs of the count number 
are in simultaneous timing with the pulses of the signals received through the signal input terminal CK. 

The quinary counter 620 has signal input terminals CK and CL, a carry output terminal CYo and a count output ter- 

40 minal Qn, The quinary counter 620 causes all output of the count output terminal Qn thereof to be set to "0" when the 
signal input terminal CL thereof receives a signal representative of "1". After all output of the count output terminal Qn 
of the quinary counter 620 are set to "0", the quinary counter 620 counts up from "0" in step with the clock signal CK3 
received by the signal input terminal CK to output, through the count output terminal Qn, the count number that reverts 
to "0" in the sequence of counting after reaching a maximum value of "4". The quinary counter 620 outputs the carry 

45 signal through the carry output terminal CYo when the count number is reverted to "0". 

The flip-flop 630 is constituted by D flip-flop and thus has a count input terminal, a signal input terminal 630a and 
a count output terminal. The flip-flop 630 is designed to latch data received through the count input terminal in simulta- 
neous timing with the pulses of the signals received through the signal input terminal 630a. 

The flip-flop 640 is constituted by D flip-flop and thus has a count input terminal, a signal input terminal 640a and 

so a count output terminal. The flip-flop 640 is designed to latch data received through the count input terminal in simulta- 
neous timing with the pulses of the signals received through the signal input terminal 640a. 

The signal input terminal CL of the quinary counter 610 is electrically connected to the signal output terminal of the 
timing control unit 900 to receive the control signal LD. while the signal input terminal CK the quinary counter 610 is 
electrically connected to the signal output terminal of the timing control unit 900 to receive the control signal CK3. The 

55 signal input terminal CL of the quinary counter 620 is electrically connected to the signal output terminal of the timing 
control unit 900 to receive the control signal LD, while the signal input terminal CK of the quinary counter 620 is electri- 
cally connected to the signal output terminal of the timing control unit 900 to receive the control signal CK3. The carry 
output terminal CYo of the quinary counter 620 is electrically connected to the carry input terminal CYi of the quinary 
counter 610. 
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The count input terminal of the flip-flop 630 is electrically connected to the count output terminal Qn of the quinary 
counter 610 and the signal input terminal 630a of the flip-flop 630 is electrically connected to the signal output terminal 
of the logical product element 531 of the distortion specifying means 500 to receive the signal Min. 

The count input terminal of the f iip-f lop 640 is electrically connected to the count output terminal Qn of the quinary 
counter 620 and the signal input terminal 640a of the flip-flop 640 is electrically connected to the signal output terminal 
of the logical product element 531 of the distortion specifying means 500 to receive the signal Min. 

The operation of the motion estimation apparatus thus constructed will be described hereinafter with reference to 
FIGS 13 to 24. A matrix array of squares shown in each of FIGS. 14-23 corresponds to a matrix array of shift registers 
RE(0 -1) RE(1,-1). RE(2,-1), RE(3,-1). RE(3,0), RE(3,1). RE(3,2), RE(3,3),RE(2,3), RE(1,3), RE(0,3) and the proces- 
sor elements PE1a(0,0), PE1a(0,1), PE1a(0,2), PE1a(1,0), PE1a(1,1). PE1a(1,2), PE1a(2,0), PE1a(2,1), PEla(2,2) 
shown in FIG. 8. 

As will be understood from the clock signal CK1 and the control signals SU and SL shown in FIG. 13, before each 
of the clock pulses of the clock signal CK1 is outputted, the combination of the signal levels of the control signals SU 
and SL is changed. More specifically, before the first, second third and fourth clock pulses of the clock signal CK1 are 
outputted, the selector 1 301 is operated to select the third data input terminal C, the first data input terminal A, the third 
data input terminal C and the second input terminal B of the selector 1301 , respectively. The selection operation by the 
selector 1301 is repeated after the fifth clock pulse of the clock signal CK1 . 

when the D flip-flop 1302 detects a rising edge of a pulse of the clock signal CK1 , each of the pel data currently 
selected by the data input terminal of the selector 1301 is latched by the D flip-flop 1302 of the processor element and 
accordingly outputted to the other processor elements and shift registers through the data output terminals YUo, YDo, 
YLo of the present processor element. 

Each of the processor elements and each of the registers is operated to receive data from the right side processor 
element or register, the upper side processor element or register, the right side processor element or register and the 
lower side processor element or register in FIG. 8 in step with the first, second third and fourth clock pulses of the clock 
pulse signal CK1 , respectively. The receiving operation is repeated after the fifth clock pulse of the clock signal CK1 . 

Firstly, the motion estimation apparatus is initialized between the first pulse and the sixth pulse of the clock signal 
CK1 shown in FIG. 13. When the first pulse of the clock signal CK1 is outputted from the timing control unit 900, the pel 
data c(0.1)/2 and c(0,3)/2 are supplied from the multipliers 41 1 and 412 of the candidate block obtaining means 400 to 
the shift registers RE(3,0) and RE(3,2), respectively, as shown in FIG. 14. 

When the second pulse of the clock signal CK1 is outputted from the timing control unit 900, the pel data c(0,1)/2 
and c(0,3)/2 are shifted from the shift registers RE(3,0) and RE(3,2) to the shift registers RE(3,1) and RE(3,3), respec- 
tively, as shown in FIG. 15. At the same time, the pel data c(0,0)/2 and c(0,2)/2 are supplied from the multipliers 41 1 
and 412 of the candidate block obtaining means 400 to the shift registers RE(3,0) and RE(3,2), respectively. 

When the third pulse of the clock signal CK1 is outputted from the timing control unit 900, the pel data c(0,0)/2, 
c(0, 1 )/2, c(0,2)/2 and c(0,3)/2 are shifted from the shift registers RE(3,0), RE(3. 1 ), RE(3,2) and RE(3,3) to the processor 
elements PE1a(2,0), PE1a(2,1) and PE1a(2,2), and the shirt registers RE(2,3) t respectively, as shown in FIG. 16. At 
the same time, the pel data c(1 ,0)/2 and c(1 ,2)/2 are supplied from the multipliers 41 1 and 412 of the candidate block 
obtaining means 400 to the shift registers RE(3,0) and RE(3,2), respectively. 

When the fourth pulse of the clock signal CK1 is outputted from the timing control unit 900, the pel data c(0,0)/2, 
c(0,1)/2, c(0,2)/2, c(0,3)/2, c(1,0)/2 and c(1,2)/2 are shifted from the processor elements PE1a(2,0), PE1a(2,1) and 
PE1a(2,2), and the shift registers RE(2,3), RE(3,0), RE(3,2) to the shift register RE(2,-1), the processor elements 
PE1a(2,0), PE1a(2, 1) and PE1a(2,2), shift registers RE(3,-1) and RE(3,1), respectively, as shown in FIG. 17. At the 
same time, the pel data c(1, 1)/2 and c(1, 3)/2 are supplied from the multipliers 411 and 412 of the candidate block 
obtaining means 400 to the shift registers RE(3,0) and RE(3,2), respectively. 

When the fifth pulse of the clock signal CK1 is outputted from the timing control unit 900, the pel data c(0,0)/2, 
c(0 1)/2, c(0,2)/2, c(0,3)/2, c(1,0)/2, c(1,1)/2, c(1,2)/2and c(1,3)/2 are shifted from the shift register RE(2, -1), processor 
elements PEla(2,0), PE(2,1) and PE1a(2,2), shift registers RE(3,-1), RE(3,0), RE(3,1), RE(3,2) to the shift register 
RE(1,-1), processor elements PE1a(1,0), PE1a(1,1) and PE1a(1,2), shift register RE(2,-1), processor elements 
PE1a(2,0), PEla(2,1) and PE1a(2,2), respectively, as shown in FIG. 18. At the same time, the pel data c(2,1)/2 and 
c(2,3)/2 are supplied from the multipliers 41 1 and 412 of the candidate block obtaining means 400 to the shift registers 
RE(3,0) and RE(3,2), respectively. 

When the sixth pulse of the clock signal CK1 is outputted from the timing control unit 900, the pel data c(0,0)/2, 
c(0,1)/2, c(0,2)/2, c(0,3)/2, c(1,0)/2, c(1,1)/2, c(l,2)/2, c(1,3)/2, c(2,1)/2 and c(2,3)/2 are shifted from the shift register 
RE(V1). processor elements PE1a(1,0), PE1a(1,1) and PE1a(1,2), shift register RE(2,-1), processor elements 
PEla(2,0), PE1a(2,1) and PE1a(2,2), shift registers RE(3,0) and RE(3,2) to the processor elements PE1a(1,0), 
PE1a(l!l) and PE1a(1.2), shift register RE(1,3), processor elements PE1a(2,0), PE1a(2,1) and PE1a(2,2), shift regis- 
ters RE(2,3), RE(3,1) and RE(3,3), respectively, as shown in FIG. 19. At the same time, the pel data c(2,0)/2 and 
c(2,2)/2 are supplied from the multipliers 41 1 and 412 of the candidate block obtaining means 400 to the shift registers 
RE(3,0) and RE(3,2), respectively. 
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When the seventh pulse of the CK1 is outputted from the timing control unit 900, the pel data c(0,0)/2, c(0,1)/2, 
c(0.2)/2, c(0,3)/2, c(1 ,0)/2, c(1 ,1 )/2, c(1 ,2)/2, c(1 ,3)/2, c(2,0)/2, c(2.1)/2, c(2 ( 2)/2, c(2,3)/2 are shifted from the processor 
elements PE1a(1,0), PE(1,1) and PE(1 t 2), shift register RE(1,3). processor elements PE1a(2,0), PE1a(2,1) and 
PE1a(2,2), shift registers RE (2,3) and RE (3,0), RE(3,1), RE(3,2) and RE(3.3) to the processor elements PE1a{0.0), 

5 PE1a(0,1) and PE1a(0,2), shift register RE(0,3), processor elements PE1a(1,0), PE1a(1.1) and PE1a(1,2), shift regis- 
ter RE(1,3). processor elements PE1a(2,0), PEla(2,l) and PE1a(2,2), and shift register RE(2,3), respectively, as 
shown in FIG. 20. At the same time, the pel data c(3,0)/2 and c(3,2)/2 are supplied from the multipliers 41 1 and 412 of 
the candidate block obtaining means 400 to the shift registers RE(3,0) and RE(3,2), respectively. 

When the eighth pulse of the CK1 is outputted from the timing control unit 900, the integer pel data c(0,0)/2, 

w c(0,1)/2, c(0,2)/2, c(0,3)/2, c(1,0)/2, c(1 ,1)/2, c(1,2)/2, c(1,3)/2, c(2,0)/2, c(2,1)/2, C(2,2)/2. c(2,3)/2, c(3.0)/2 and c(3 ( 2)/2 
are shifted from the processor elements PE1a(0,0), PE1a(0,1) and PE1a(0,2), shift register RE(0,3), processor ele- 
ments PE1a(1,0), PE1a(1,1) and PE1a(1.2), shift register RE(1,3), processor elements PE1a(2,0), PE1a(2,1) and 
PE1a(2,2), and shift registers RE(2 ( 3). RE(3,0) and RE(3.2) to the shift register RE(0,-1), processor elements 
PE1a(0,0). PE1a(0,1) and PE1a(0,2), shift register RE(1,-1), processor elements PE1a(1.0), PE1a(1,1) and PE1a(1,2), 

is shift register RE(2,-1), processor elements PE1a(2,0), PE1a(2,1) and PE1a(2,2), and shift registers RE(3,-1) and 
RE(3, 1 ), respectively, as shown in FIG. 21 . At the same time, the integer pel data c(3, 1 )/2 and c(3,3)/2 are supplied from 
the candidate block obtaining means 400 to the shift registers RE(3,0) and RE(3,2), respectively. 

When the ninth pulse of the CK1 is outputted from the timing control unit 900, the integer pel data c(1 ,0)/2, c(1 ,1)/2, 
c(1,2)/2, c(1,3)/2, c(2,0)/2, c(2,1)/2, c(2,2)/2, c(2,3)/2, c(3.0)/2, (3,1)/2, c(3,2)/2 and c(3,3)/2 are shifted from the shift 

20 register RE(1,-1), processor elements PE1a(1,0), PE1a(1,1) and PE1a(1,2), shift register RE(2,-1), processor elements 
PE1a(2,0), PE1a(2,1) and PE1a(2,2), and shift registers RE(3,-1), RE(3,0), RE(3,1) and RE(3,2) to the shift register 
RE(0,-1), processor elements PE1a(0,0), PEla(0,1) and PE1a(0,2), shift register RE(1,-1), processor elements 
PE1a(1,0), PE1a(1,1)and PE1a(1,2), shift register RE(2,-1), processor elements PE1a(2,0), PE1a(2,1)and PE1a(2,2), 
respectively, as shown in FIG. 22. At the same time, the integer pel data c(4, 1 )/2 and c(4,3)/2 are supplied from the can- 

25 didate block obtaining means 400 to the shift registers RE(3, 0) and RE(3, 2), respectively. 

When the tenth pulse of the CK1 is outputted from the timing control unit 900, the integer pel data c(1 ,0)/2, c(1,1)/2, 
c(1,2)/2, c(1,3)/2, c(2,0)/2, c(2,1)/2, c(2,2)/2, C(2,3)/2, c(3,0)/2, c(3,1)/2, c(3,2)/2, c(3,3)/2, c(4,1)/2 and c(4,3)/2 are 
shifted from the shift register RE(0,-1), processor elements PE1a(0,0), PE1a(0,1) and PE1a(0,2), shift register RE(1 
1), processor elements PE1a(1,0), PE1a(1,1), and PE1a(1,2), shift register RE(2,-1), processor elements PE1a(2,0), 

30 PE1a(2,1) and PE1a(2,2), and shift registers RE(3,0) and RE(3,2) to the processor elements PE1a(0,0), PE1a(0,1) and 
PE1a(0,2), shift register RE(0,3), processor elements PE1a(1,0), PE1a(1,1) and PE1a(1 ,2), shift register RE(1,3), proc- 
essor elements PE1a(2,0), PE1a(2,1) and PE1a(2,2), and shift registers RE(2,3), RE(3,1) and RE(3,3), respectively, as 
shown in FIG. 23. At the same time, the integer pel data c(4,0)/2 and c(4,2)/2 are supplied from the candidate block 
obtaining means 400 to the shift registers RE(3,0) and RE(3,2), respectively. 

35 Next, each of the processor elements PE1a(x,y) of the motion estimation apparatus calculates local distortion val- 
ues during the period (g) to 0). 

Before the beginning of the period (g), the second signal input terminal 1307b of the D flip-flop 1307 of each of the 
processor elements PE(x,y) is supplied the control signal CLE from the timing control unit 900. Accordingly, the D flip- 
flop 1307 detects a low-to-high transition of the signal received by the second signal input terminal 1307b and resets 

40 data on the data output terminal to "0". 

During the period (g) shown in Fig. 13, the pel data sets c(0,0)/2, c(0,1)/2, c(0,2)/2, c(1,0)/2, c(1,1)/2, c(1,2)/2, 
c(2,0)/2, c(2, 1 )/2, c(2,2)/2, are received in described order by the first data input terminal A of the subtracter 1 303 of the 
processor elements PE1a(0,0), PE1a(0,1), PEla(0,2), PE1a(1,0), PE1a(1,1), PE1a(1,2), PE1a(2,0), PE1a(2,1) and 
PE1a(2,2), respectively, from the D flip-flop 1302 of each of the processor elements PE1a(x,y). The pel data sets 

45 c(0,3)/2, c(1 ,3)/2, c(2,3)/2, c(3,0)/2, c(3,2)/2 are also received in described order by the shift registers RE(0,3), RE(1 ,3), 
RE(2,3), RE(3,0) and RE(3,2). At the same time, the pel data a(0,0)-b(0,0)/2 of the template block 4a is supplied from 
the template block obtaining means 200 to each of the processor elements PE1a(x,y) through the data input terminal 
. X of the present processor element PE(x, y) and the second data input terminal B of the subtracter 1303 of each of the 
processor elements PE1a(x,y), respectively. 

so The pel data a(0,0)-b(0,0)/2 and the pel data c(x,y)/2 are received by the subtracter 1 303 of each of the processor 
elements PE1a(x,y) and accordingly data indicated by {c(x,y)/2}-{a(0,0)-b(0,0)/2} are calculated by the subtracter 1303. 
The data calculated by the subtracter 1303 is transmitted to the positive value transducer 1305 and converted to data 
recited as follows: 

55 |{c(x,y)/2}-{a(0,0)-b(0,0)/2}| 

The converted data is transmitted from the positive value transducer 1305 to the adder 1306 through the data input ter- 
minal A and data output terminal B of the adder 1306 and the D flip-flop 1307. 
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During the period (h) in FIG. 13, the pel data sets c(x,y+1)/2 are received by the first data input terminal A of the 
subtracter 1303 of each of the processor elements PE1a(x,y) from the D flip-flop 1302 through the data output terminal 
of the D flip-flop 1 302 of the lower side processor element PE 1 a(x,y+1 ) or the data output terminal of the lower side shift 
registers RE(x,y+1) in FIG. 8. At the same time, the pel data a(0,1)-b(0,1)/2 of the template block 4a is supplied from 
the template block obtaining means 200 to each of the processor elements PE1a(x,y) through the data input terminal 
X of the present processor element PE1a(x,y) and the second data input terminal B of the subtracter 1303 of each of 
the processor elements PE1a(x, y). 

The pel data sets a(0,l)-b(0,1)/2 and c(x,y+1)/2 are received by the subtracter 1303 of each of the processor ele- 
ments PEla(x.y), and accordingly data indicative of {c(x,y+l)/2}-{a(0,1)-b(0,1)/2} are calculated by the subtracter 1303 
and transmitted from the subtracter 1303 to the positive value transducer 1305. The data calculated by the subtracter 
1303 is converted to data indicative of |{c(x,y+1)/2}-{a(0,1)-b(0,1)/2}| and transmitted to the first data input terminal A 
of the adder 1306 in which data indicative of the following expression is calculated by the adder 1306. 

|{c(x,y)/2}-{a(0,0)-b(0,0)/2}| 
+ |{c(x,y+1)/2}-{a(0,1)-b(0 ( 1)/2}| 

The data calculated by the adder 1306 is transmitted to the second data input terminal B of the adder 1306. 

During the period (i) shown in FIG. 1 3, the pel data sets c(x+1 ,y+1 )/2 are received by the first data input terminal A 
of the subtracter 1303 of each of the processor elements PE1a(x,y) from the D flip-flop 1302 through the data output 
terminal of the D flip-flop 1302 of the right side processor element PE1a(x+1 ,y) or the data output terminal of the right 
side shift registers RE(x+1 ,y) in FIG. 8. At the same time, the pel data a(1 ,1)-b(1 ,1)/2 of the template block 4a is sup- 
plied from the template block obtaining means 200 to each of the processor elements PE1a(x,y) through the data input 
terminal X of the present processor element PE1a(x,y) and the second data input terminal B of the subtracter 1303 of 
each of the processor elements PE1a(x,y). 

The pel data a(1,1)-b(1,1)/2 and c(x+l,y+l)/2 are received by the subtracter 1303 of each of the processor ele- 
ments PEla(x.y) and accordingly data indicative of {c(x+1.y+1)/2}-{a(l,1)-b(1,1)/2} are calculated by the subtracter 
1303 and transmitted from the subtracter 1303 to the positive value transducer 1305. The data calculated by the sub- 
tracter 1303 is converted to data indicative of |{c(x+1 ,y+1)/2}- {a(l ,1)-b(1,1)/2}| and transmitted to the first data input 
terminal A of the adder 1306 in which data indicative of the following expression is calculated by the adder 1306. 

|{c(x,y)/2}-{a(0,0)-b(0,0)/2}| 
+ |{c(x,y+1)/2}-{a(0,1)-b(0,1)/2}| 
+ |{c(x+1 ,y+1 )/2}-{a(1 , 1 )-b(1 , 1 )/2}| 

The data calculated by the adder 1306 is transmitted to the second data input terminal B of the adder 1306. 

During the period (j) shown in FIG. 1 3, the pel data sets c(x+1 ,y)/2 are received by the first data input terminal A of 
the subtracter 1303 of each of the processor elements PE1a(x,y) from the D flip-flop 1302 through the data output ter- 
minal of the D flip-flop 1302 of the upper side processor element PE1a(x,y-1) or the data output terminal of the upper 
side shift registers RE(x,y-l ) in FIG. 8. At the same time, the pel data a(1 ,0)-b(1 ,0)/2 of the template block 4a is supplied 
from the template block obtaining means 200 to each of the processor elements PEla(x.y) through the data input ter- 
minal X of the present processor element PEla(x.y) and the second data input terminal B of the subtracter 1 303 of each 
of the processor elements PE1a(x,y). 

The pel data a(1 ,0)-b(1 ,0)/2 and c(x+1 ,y)/2 are received by the subtracter 1303 of each of the processor elements 
PE1a(x,y) and accordingly data indicative of {c(x+1,y)/2}-{a(1,0)-b(l,0)/2} are calculated by the subtracter 1303 and 
transmitted from the subtracter 1303 to the positive value transducer 1305. The data calculated by the subtracter 1303 
is converted to data indicative |{c(x+1,y)/2}-{a(1,0)-b(l,0)/2}| and transmitted to the first data input terminal A of the 
adder 1306 in which data indicative of the following expression is calculated by the adder 1306. 

|{c(x,y)/2}-{a(0,0)-b(0,0)/2}| 
+ |{c(x,y+1)/2}-{a(0,1)-b(0,1)/2}| (Q1) 
+ |{c(x+1 ,y+1 )/2}-{a(1 , 1 )-b(1 . 1 )/2}| 
+ |{c(x+1,y)/2}-{a(1,0)-b(1,0)/2}| 

In step with the pulse of the control signal LD in the period G), the second data input terminal B of the selector 
1308 is selected so as to connect with the data output terminal thereof. The data indicative of (Q1) calculated by the 
adder 1306 is outputted from the data output terminal Dlo of each of the processor element PE1a(x,y) through the D 
flip-flop 1307, the selector 1308 and the D flip-flop 1309 in step with the eleventh pulse of the clock pulse CK1 , i.e., the 
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first pulse of the control signal CK2 in FIG. 13. In the case of the processor element PE1a(1,1), data indicative of the 
following expression is outputted through the data output terminal Dlo of the processor element PE1a(1 ,1). 

|{c(1,1)/2}-{a(0,0)-b(0,0)/2}| 
+ |{c(1.2)/2}-{a(0,1)-b(ai)/2}| 
+ |{c(2,2)/2Ha(1,1)-b(1,1)/2}| 
+ |{c(2,1)/2}-{a(1,0)-b(1,0)/2}| 

During the period (g), the data {c(x,y)/2}-(a(0,0)- b(0,0)/2} are received by the first data input terminal A of the 
adder 1313 of each of the processor elements PE1a(x,y) from the subtracter 1303 of the present processor elements 
PE1a(x,y) through the data output terminal of the subtracter 1303. At the same time, the data 
{c(x,y+1)/2}-{a(0,0)-b(0,0)/2} are received by the second data input terminal B of the adder 1313 of each of the proc- 
essor elements PE1a(x,y) from the data output terminal of the subtracter 1303 of the lower side processor elements 
PE1a(x,y+1) in Fig. 8. 

In each of the processor elements PE1a(x,y), data indicative of 
{c(x.y)/2(a(0,0)- b(0,0)/2)}+{c(x,y+1)/2-(a(0 t 0)-(0,0)/2)} is calculated by the adder 1313 and transmitted from the sub- 
tracter 1313 to 1/2 multiplier 1 314, and are multiplied 1/2 by multiplier 1314. The multiplied data is converted by the pos- 
itive value transducer 1315 to data recited as follows: 

|[{c(x ( y)/2-(a(0,0)-b(0,0)/2)}+{c(x,y+1)/2-(a(0 l 0)-b(0,0)/2)}]/2| 

The converted data is transmitted to the second data input terminal B of the adder 1316 through the first data input ter- 
minal A and the data output terminal of the adder 1316 and the D flip-flop 1317. 
25 During the period (h), an arithmetic operation similar to that in the period (g) is carried out, and as a consequence 

data indicative of |[{c(x,y+i)/2-(a(0,1)- b(0,1)/2)}+{c(x,y+2)/2-(a(0,1)-b(0,1)/2)}]/2| is calculated by the positive value 
transducer 1315 and transmitted to the adder 1316 in which data indicative of the following expression is calculated. 

([{ctx.yJ^-tafO.OJ-b^.O^JJ+^Cx.y+IJ^-CafO.OJ-bCO.O)^)}]^! 
30 + |[{c(x,y+1)/2-(a(0,1)-b^ 



The data calculated by the adder 1316 is transmitted to the second data input terminal B of the adder 1316 by way of 
the D flip-flop 1317. 

35 During the period (i), an arithmetic operation similar to that in the period (g) is carried out, data indicative of 
|[{c(x+1,y+1)/2-{a(1,1)-b(1,1)/2)}+{c(x+1,y+2)/2- (a(1 ,1 )-b(1 ,1)/2)}]/2| are calculated by the positive value transducer 
1315 and transmitted to the adder 1316 in which data indicative of the following expression is calculated. 

|[{c(x I y)/2-(a(0.0)-b(0.0)/2)}+{c(x,y+1)/2-(a(0,0)-b(0,0)/2)}]/2| 
40 + |[{c(x,y+1)/2-(a(0,1)-b(0 ( 1)/2)}+{c(x,y+2)/2-(a(0,1)-b(0,1)/2}]/2 

+ |[{c(x+1,y+1)/2-(a(1,1)-b(^^ 



The data calculated by the adder 1316 is transmitted to the second data input terminal B of the adder 1316 by way of 
45 the D flip-flop 1317. 

During the period 0). an arithmetic operation similar to that in the period (g) "is carried out, data indicative of 
|[{c(x+1,y)/2-(a(1,0)-b(1,0)/2)}+{c(x+1,y+1)/2-(a(1 l 0)- b(1,0)/2)}]/2| are calculated by the positive value transducer 
1315 and transmitted to the adder 1316 in which data indicative of the following expression is calculated. 

50 |[{c(x,y)/2-(a(0,0)-b(0,0)/2)}+{c(x,y+1)/2-(a(0,0)-b(0,0)/2)}]/2| 

+ |[{c(x,y + 1)/2-(a(0,1^ 

+ |[{c(x+1,y+1)/2-(a(1,1)-b(1,1)/2)}+{c(x+1,y+2)/2-(a(1,1 )-b(1,1)/2)}J/2| { } 

+ |[{c(x+1 ,y)/2-(a(1 ,0)-b(l ,0)/2)}+{c(x+1 ,y+l)/2-(a(1 ,0)-b(l ,0)/2)}]/2| 

55 

In step with the pulse of the control signal LD in the period 0). the second data input terminal B of the selector 
1318 is selected so as to connect with the data output terminal thereof. The data indicative of (Q2) calculated by the 
adder 1316 is outputted from the data output terminal Dlo of each of the processor element PE1a(x,y) through the D 
flip-flop 1317, the selector 1318 and the D flip-flop 1319 in step with the eleventh pulse of the clock pulse CK1, i.e., the 
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first pulse of the control signal CK2 in FIG. 13. In the case of the processor element PE1a(l ,1), data indicative of the 
following expression is outputted through the data output terminal Do of the processor element PE1a(1 ,1). 

|[{c(1 J)/2-(a(O.0)-b(O i 0)y2)}+(c(1 I 2)/2-(a(O l 0)-b(O i 0)/2)}J^| 
+ |[{(c(1 ,2)/2-(a(0, 1 -)b(0. 1 )/2)}+{c(1 .3)/2-(a(0, 1 )-b(0, 1 )/2)}3/2| 
+ |[{c(2,2)/2-(a(1 , 1 )-b(1 , 1 )/2)}+{c(2,3)/2-(a(1 , 1 )-b(1 . 1 )/2)}]/2| 
+ |[{C(2,1 )/2-(a(1 ,0)-b(1 ,0)/2)}+{c(2,2)/2-(a(1 ,0)-b(1 ,0)/2)}]/2| 

During the period (g), the data {c(x,y)/2}-{a(0,0)- b(0,0)/2} are received by the first data input terminal A of the 
adder 1323 of each of the processor elements PE1a(x,y) from the subtracter 1303 of the present processor elements 
PE1a(x,y) through the data output terminal of the subtracter 1303. At the same time, the data 
{c(x+1 y)/2}-{a(0,0)-b(0,0)/2} are received by the second data input terminal B of the adder 1323 of each of the proc- 
essor elements PE1a(x,y) from the data output terminal of the subtracter 1303 of the right side processor elements 
PE1a(x+1 ,y) or the right side shift register RE (x+1 ,y) in FIG. 8. 

In each processor element PE1a(x,y), data indicative of {c(x,y)/2-(a(0,0)- b(0,0)/2)}+{c(x+1 ,y)/2-(a(0,0)-(0,0)/2)} is 
calculated by the adder 1 323 and multiplied 1 12 by multiplier 1 324. The multiplied data is converted by the positive value 
transducer 1325 to data recited as follows: 

[[^(x.yi^^aCO.OJ-bCO.OJ^JJ+lcCx+l.yJ^-tafO.OJ-bfO.O)^)}]^! 

The converted data is transmitted to the second data input terminal B of the adder 1 326 through the first data input ter- 
minal A and the data output terminal of the adder 1326 and the D flip-flop 1327. 

During the period (h), an arithmetic operation similar to that in the period (g) is carried out. data indicative of 
|[{c(x,y+1)/2-(a(0,1)-b(0,1)/2)}+{c(x+1,y+1)/2-(a(0,1)- b(0,1)/2)}]/2| are calculated by the positive value transducer 
1325 and transmitted to the adder 1326 in which data indicative of the following expression is calculated. 

|[{c(x,y)/2-(a(0,0)-b(0 l 0)/2)}+{c(x+1 l y)/2-(a(0,0)-b(0,0)/2)}]/2| 
+ |[{c(x,y+1 )/2-(a(0, 1 )-b(0, 1 )/2)}+{c(x+1 ,y+1 )/2-(a(0, 1 )-b(0,1 )/2)}]/2| 



The data calculated by the adder 1326 is transmitted to the second data input terminal B of the adder 1326 by way of 
the D flip-flop 1327. 

During the period (i), an arithmetic operation similar to that in the period (g) is carried out, data indicative of 
|[{c(x+1,y+1)/2-(a(1,1)-b(1,1)/2)}+{c(x+2,y+1)/2- (a(l,1)-b(l,l)/2)}]/2| are calculated by the positive value transducer 
1315 and transmitted to the adder 1326 in which data indicative of the following expression is calculated. 

|[{c(x,y)/2-(a(0,0)-b(0,0)/2)}+{c(x+1 t y)/2-(a(0,0)-b(0,0)/2)}]/2| 
+ |[{c(x.y+1)/2-(a(0,1)^ 
+ |[{c(x+1,y+1)/2-(a(1.1)^ 

The data calculated by the adder 1326 is transmitted to the second data input terminal B of the adder 1326 by way of 
the D flip-flop 1327. 

During the period (j), an arithmetic operation similar to that in the period (g) is carried out, data indicative of 
|[{c(x+1,y)/2-(a(1,0)-b(1,0)/2)}+{c(x+2,y)/2-(a(1,0)- b(1,0)/2)}]/2| are calculated by the positive value transducer 1325 
and transmitted to the adder 1326 in which data indicative of the following expression is calculated. 

|[{c(x,y)/2-(a(0,0)-b(0,0)/2)}+{c(x+1 l y)/2-(a(0 ( 0)-b(0,0)/2)}]/2| 
+ |[{c(x,y+1 )/2-(a(0, 1 )-b(0, 1 )/2)}+{c(x+1 ,y+1 )/2-(a(0, 1 )-b(0, 1 )/2)}]/2| Q3) 
+ |[{c(x+1 ,y+1 )/2-a(1 ,1 )-b(1 , 1 )/2)}+{c(x+2,y+1 )/2-(a(1 , 1 )-b(1 . 1 )/2)}]/2| 
+ |[{c(x+1 ,y)/2-(a(1 ,0)-b(1 ,0)/2)}+{c(x+2,y)/2-(a(1 ,0)-b(1 ,0)/2)}]/2| 

In step with the pulse of the control signal LD in the period 0) the second data input terminal B of the selector 
1328 is selected so as to connect with the data output terminal thereof The data indicative of (Q3) calculated by the 
adder 1326 is outputted from the data output terminal DHo of each of the processor element PE1a(x,y) through the D 
flip-flop 1327, the selector 1328 and the D flip-flop 1329 in step with the eleventh pulse of the clock pulse CK1 , i.e., the 
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first pulse of the control signal CK2 in FIG. 13. In the case of the processor element PE1a(1,1), data indicative of the 
following expression is outputted through the data output terminal DHo of the processor element PE1a(1 ,1). 

|[{c(1,1)/2-(a(0.0)-b(0,0)/2)}+{c(2,1)/2-(a(0,0)-b(0,0)/2)}]/2| 
5 + |[{c(1 ,2)/2-(a(0, 1 )-b(0, 1 )/2)}+{c(2,2)/2-(a(0, 1 )-b(0, 1 )/2)}]/2| 

+ |[{c(2.2)/2-(a(1 , 1 )-b( 1 . 1 )/2)}+{c(3,2)/2-(a(1 , 1 )-b( 1 , 1 )/2)}]/2| 
+ |[{c(2,1 )/2-(a(1 .0)-b(1 .0)/2)}+{c(3, 1)/2-(a(1 .0)-b(1 .0)/2)}]/2| 

w During the period (g), data indicative of [{c(x,y+l)/2-(a(0,0)- b(0,0)/2)}+{c(x+1,y+1)/2-(a(0,0)-b(0,0)/2}]/2 is 

received by the first data input terminal A of the adder 1333 of each of the processor elements PE1a(x,y) from the mul- 
tiplier 1324 of the lower side processor elements PE1 a(x,y+1 ) in FIG. 8 through the data output terminal of the multiplier 
1324. At the same time, data indicative of [{c(x t y)/2-(a(0 l 0)-b(0 l 0)/2)}+{c(x+1,y)/2-(a(0,0)-b(0,0)/2)}]/2 is received by 
the second data input terminal B of the adder 1333 of each of the processor elements PE1a(x,y) from the multiplier 

is 1324 of the same processor elements PE1a(x,y) through the data output terminal of the multiplier 1324. 

In each processor element PE(x.y), data indicative of [{cCx.yJ^^a^.OJ- 
bfO.OJ^JJ+fcfx+l.yJ^^afO.O-btO.O^J^+Hcfx.y+IJ^-Ca^.O)- btO.OJ^JJ+fcfx+l.y+l^-fafO.OJ-bCO.O)^}]^ are calcu- 
lated by the adder 1333 and multiplied 1/2 by multiplier 1334. The multiplied data is converted by the positive value 
transducer 1335 to data indicative of an expression recited as follows: 

20 

|[[{c(x,y)/2-(a(0,0)-b(0.0)/2)} 
+ {C(x+1 t y)/2-(a(0,0)-b(0,0)/2}]/2 
+ [{c(x,y+1)/2-(a(0,0)-b(0,0)/2)} 
25 + {c(x+1 ,y+1)/2-(a(0,0)-b(0,0)/2}]/2]/2| 

The data converted by the positive value transducer 1335 is transmitted to the second data input terminal B of the adder 
1 336 through the first data input terminal A and data output terminal of the adder 1 336 and the D flip-flop 1 337. 

During the period (h), a arithmetic operation similar to that in the period (g) is carried out and accordingly data 
so indicative of |[[{c(x,y+1 )/2-(a(0, 1 )- b(0, 1 )/2)}+{c(x+1 ,y+1 )/2-(a(0, 1 )-b(0, 1 )/2}]/2+[{c(x,y+2)/2-(a(0, 1 )- 

b(0,1)/2)}+{c(x+1,y+2)/2-(a(0,1)-b(0,1)/2)]/2]/2| is calculated by the positive value transducer 1335 and transmitted to 
the adder 1336 in which data indicative of the following expression is calculated. 

|[[{c(x,y)/2-(a(0 ( 0)-b(0,0)/2)} 
35 + {c(x+1,y)/2-(a(0.0)-b(0,0)/2}]/2 

+ [{c(x,y+1)/2-(a(0,0)-b(0,0)/2)} 
+ {c(x+1 ,y+1 )/2-(a(0 ( 0)-b(0,0)/2}]/2]/2| 
+ |[[{c(x,y + 1)/2-(a(0,1)-b(0,1)/2)} 
40 + {c(x+1 ( y+1)/2-(a(0,1)-b(0,1)/2}]/2 

+ [{c(x,y+2)/2-(a(0, 1 )-b(0, 1 )/2)} 
+ {c(x+1 ,y+2)/2-(a(0,1 )-b(0, 1)/2}]/2]/2| 



45 The data calculated by the adder 1 336 is transmitted to the second data input terminal B of the adder 1336 through the 
D flip-flop 1337. 

During the period (i), a arithmetic operation similar to that in the period (g) is carried out, and accordingly data indic- 
ative of |[[{c(x+1,y+1)/2-a(1 t 1)- b(1 ,1)/2)}+{c(x+2.y+1)/2-(a(1 ,1)-b(1 ,1)/2}]/2+[{c(x+1 t y+2)/2-(a(1,1)- 
b(1,1)/2)}+{c(x+2,y+2)/2-(a(1 l 1)-b(1,1)/2}]/2]/2| is calculated by the positive value transducer 1335 and transmitted to 
so the adder 1336 in which data indicative of the following expression is calculated. 
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|[[{c(x,y)/2-(a(0,0)-b(0,0)/2)} 
+ {c(x+1 ,y)/2-(a(0,0)-b(0,0)/2}]/2 
+ [{c(x,y+1 )/2-(a(0,0)-b(0,0)/2)} 
+ {c(x+1 ,y+1)/2-(a(0 t 0)-b(0.0)/2}]/2]/2| 
5 +|[[{c(x,y+1)/2-(a(0,1)-b(0,1)/2)} 

+ {c(x+1 ,y+1 )/2-(a(0, 1 )-b(0, 1 )/2}]/2 
+ [{c(x,y+2)/2-(a(0,1)-b(0,1)/2)} 
+ {c(x+1 .y+2)/2-(a(0 I 1)-b(0,1)/2}]/2]/2| 
10 + |[[{c(x+1 ,y+1 )/2-a(1 , 1 )-b(1 , 1 )/2)} 

+ {c(x+2,y+1 )/2-(a(1 , 1 )-b(1 , 1 )/2}]/2 
+ [{c(x+1 ,y+2)/2-(a(1 , 1 )-b(1 , 1 )/2)} 
+ {c(x+2,y+2)/2-(a(1,1)-b(1 t 1)/2}]/2]/2| 

15 

The data calculated by the adder 1336 is transmitted to the second data input terminal B of the adder 1336 through the 
D flip-flop 1337. 

During the period 0). a arithmetic operation similar to that in the period (g) is carried out, and accordingly data indic- 
ative of |[[{c(x+1 ,y)/2-(a(1 ,0)-b(1 ,0)/2)} + {c(x+2,y)/2-a(1 ,0)-b(1 ,0)/2}}/2+[{c(x+1 ,y+1)/2-(a(1 ,0)-b(1 ,0)/2)}+{c(x=2,y+1)/2- 
20 (a(1,0)-b(1.0)/2}]/2}]/2]/2| is calculated by the positive value transducer 1335 and transmitted to the adder 1336 in 
which data indicative of the following expression is calculated. 



|[[{c(x,y)/2-(a(0,0)-b(0 l 0)/2)} 
+ {c(x+1 ,y)/2-(a(0,0)-b(0,0)/2}]/2 
+ [{c(x,y+1)/2-(a(0 ( 0)-b(0,0)/2)} 
+ {c(x+1 ,y+1 )/2-(a(0,0)-b(0,0)/2}]/2]/2| 
+ |[[{c(x,y+1 )/2-(a(0, 1 )-b(0, 1 )/2)} 
+ {c(x+1 ,y+1 )/2-(a(0, 1 )-b(0, 1 )/2}]/2 
+ [{c(x,y+2)/2-(a(0,1)-b(0,1)/2)} 
+ {c(x+1 ,y+2)/2-(a(0,1)-b(0,1)/2}]/2]/2| 
+ |[[{c(x+1,y+1)/2-(a(1,l)-b(1,l)/2)} 
+ {c(x+2,y+1 )/2-(a(1 , 1 )-b(1 , 1 )/2}]/2 
+ [{c(x+1 ,y+2)/2-(a(1 , 1 )-b(l ( 1 )/2)} 
+ {c(x+2,y+2)/2-(a(1 , 1 )-b(1 , 1 )/2}]/2]/2| 
+ |[[{c(x+l,y)/2-(a(1 I 0)-b(1,0)/2)} 
+ {c(x+2,y)/2-(a(1 ,0)-b(1 ,0)/2}]/2 
+ [{c(x+1,y+1)/2-(a(1,0)-b(1,0)/2)} 
+ {c(x+2 ( y+1)/2-(a(1 ,0)-b(1 ,0)/2}]/2]/2| 



In step with the pulse of the control signal LD in the period 0). the second data input terminal B of the selector 
1338 is selected so as to connect with the data output terminal thereof. The data indicative of (Q4) calculated by the 
45 adder 1336 is outputted from the data output terminal DDo of each of the processor element PE1a(x,y) through the D 
flip-flop 1337, the selector 1338 and the D flip-flop 1339 in step with the eleventh pulse of the clock pulse CK1 , i.e., the 
first pulse of the control signal CK2 in FIG. 13. In the case of the processor element PE1a(1,1), data indicative of the 
following expression is outputted through the data output terminal DDo of the processor element PE1a(1 ,1). 
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|[[{c(1,1)/2-(a(0,0)-b(0,0)/2)} 
+ {c(2,1)/2-(a(0,0)-b(0,0)/2}]/2 
+ [{c(1,2)/2-(a(0.0)-b(0.0)/2)} 
+ {c(2,2)/2-(a(0,0)-b(0,0)/2}]/2]/2| 
+ |[[{c(1,2)/2-(a(0,1)-b(0,1)/2)} 
+ {c(2,2)/2-(a(0,1)-b(0,1)/2}]/2 
+ [{c(1,3)/2-(a(0.1)-b(0.1)/2)} 
+ {c(2,3)/2-(a(0,1 )-b(0, 1 )/2}]/2]/2| 
w +|[[{c(2.2)/2-(a(1,1)-b(1,1)/2)} 

+ {c(3, 2)/2-(a( 1 . 1 )-b( 1 , 1 )/2}]/2 
+ [{c(2 ( 3)/2-(a(1,1)-b(1,1)/2)} 
+ {c(3.3)/2-(a(1 ,1)-b(1 . 1 )/2}]/2]/2| 
, 5 +|[[{c(2,1)/2-(a(1 l 0)-b(1,0)/2)} 

+ {c(3,1)/2-(a(1,0)-b(1.0)/2}]/2 
+ [{c(2,2)/2-(a(1 ,0)-b(1 ,0)/2)} 
+ {c(3.2)/2-(a(1 ,0)-b(1 ,0)/2}]/2]/2| 

The foregoing expressions (Q1), (Q2) ( (Q3) and (Q4) are equivalent in value to the following expressions (QV), 
(Q2') ( (Q3') and (Q4'). 



20 



25 



|[c(x,y)+b(0,0)]/2-a(0,0)| 
+ |[c(x,y+1)+b(0,1)]/2-a(0,1)| 
+ |[c(x+1,y+1)+b(1,1)]/2-a(1 ( 1)| 
+ |[c(x+1 ,y)+b(1 ,0)]/2-a(1 ,0)| 

30 IfcCx.yJ+cCx.y+l^+bCO.OJJ^-aCO.O)! 

+ |[c(x t y+1 )+c(x,y+2)}/2+b(0, 1 )]/2-a(0, 1 )| 
+ |[c(x+l ,y+l )+c(x+1 ,y+2)}/2+b(1 , 1 )]/2-a(1 , 1 )| 
+ |[c(x+1 t y)+c(x+1 , y+1 )}/2+b(1 ,0)]/2-a(1 ,0)| 



(QV) 



(Q2') 
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|[c(x ( y)+c(x+1,y)}/2+b(0,0)]/2-a(0,0)| 
+ l[c(x f y+1 )+c(x+1 ,y+1 )}/2+b(0, 1 )]/2-a(0, 1 )| 
+ |[c(x+1 ,y+1 )+c(x+2,y+1 )}/2+b(1 , 1 )]/2-a(1 , 1 )| 
+ |[c(x+1 ,y)+c(x+2,y)}/2+b(1 ,0)]/2-a(1 ( 0)| 



(Q3*) 



40 



(Q4') 



|[c(x,y)+c(x+1 ,y)+c(x,y+1 )+c(x+1 ,y+1)}/4 
+b(0.0)]/2-a(0,0)| 
+ |[c(x f y+1)+c(x+1 ,y+1)+c(x,y+2)+c(x+1 ,y+2)}/4 
45 +b(0,l)l/2-a(0,1)| 

+ |[c(x+1 ,y+t)+c(x+2,y+t)+c(x+1 ,y+2)+c(x+2,y+2)}/4 
+b(1.1)y2-a(1,1)| 
+ |[c(x+1 ,y)+c(x+2 ( y)+c(x+1 ,y+1 )+c(x+2,y+1)}/4 
+b(1.0)]/2-a(1.0)| 

50 

The foregoing expression (QV) represents the first distortion value indicative of a difference between each pel 
data set of each of the interpolated blocks and each integer pel data set of the current blocks 1 , each of the interpolated 
blocks being indicative of a mean between the specified reference block 2 of the first reference picture Pb and each of 
55 the first candidate blocks of the search window 3 of the second reference picture Pc shown in Fig. 4. 

The foregoing expression (Q2*) represents the second distortion value being indicative of a difference between 
each pel data set of each of the interpolated blocks and each integer pel data set of the current blocks 1 . each of the 
interpolated blocks being indicative of a mean between the specified reference block 2 of the first reference picture Pb 
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and each of the second candidate blocks vertically deviated by half-pel pitch from the first candidate blocks of the 

search window 3 of the second reference picture Pc shown in FIG. 4. 

The foregoing expression (Q3') represents the third distortion value indicative of a difference between each pel data 

set of each of the interpolated blocks and each integer pel data set of the current blocks 1, each of the interpolated 
5 blocks being indicative of a mean between the specified reference block 2 of the first reference picture Pb and each of 

the third candidate blocks horizontally deviated by half-pel pitch from the first candidate blocks of the search window 3 

of the second reference picture Pc shown in FIG. 4. 

The foregoing expression (Q4') represents the fourth distortion value indicative of a difference between each pel 

data set of each of the interpolated blocks and each integer pel data set of the current blocks 1 , each of the interpolated 
io blocks being indicative of a mean between the specified reference block 2 of the first reference picture Pb and each of 

the fourth candidate blocks diagonally deviated by half-pel pitch from the third candidate blocks of the search window 3 

of the second reference picture Pc shown in FIG. 4. 

As will be appreciated from the aforementioned description, each of the processor elements PE1a(x,y) calculates 

all of the interpolated blocks, and the distortion values each indicative of a difference between the current block 1 and 
is each of the first, second third and fourth candidate blocks. The total number of the first to fourth total candidate blocks 

is 25. 

Before the beginning of the period (k), the control signal LD representative of "1" is received by the signal input ter- 
minal S of each of the selectors 1308, 1318, 1328 and 1338 of each of the processor elements PE1a(x,y) from the tim- 
ing control unit 900, thereby causing the second data input terminal B of each of the selectors 1308, 1318, 1328 and 
20 1338 to be electrically connected to the data output terminal Y of each of the selectors 1308, 1318, 1328 and 1338. In 
step with the pulse of the control signal CK2 in the period (k), each of the processor elements PE1a(x,y) outputs each 
of the distortion values through the data output terminals of each of the D flip-flop 1309, 1319, 1329, 1339 and the data 
output terminals Dlo, DVo, DHo and DDo of each of the processor elements PE1a(x,y) shown in FIG. 10. 

Each of the distortion values calculated by the processor elements PE1a(0,y) is received by the data input termi- 

25 nals I0-I9 of the selector 510 of the distortion selecting means 500 from each of the processor elements PE1a(0,y) 
through the data output terminals Dlo, DVo, DDo, DHo of each of the processor elements PEla(0,y). At the same time, 
each of the distortion values calculated by each of the processor elements PE1a{1 ,y) and PE1a(2,y) is supplied from 
each of the processor elements PE1a(l,y) and PE1a(2,y) to the left side processor elements PE1a(x-1,y) through the 
data output terminals Dlo, DVo, DHo and DDo of each of the processor elements PE1a(x,y) and the data input terminals 

30 Dli, DVi, DHi and DDi of the left side processor elements PE1a(x-1 ,y). 

During the period (I), the control signal LD representative of "0" is received by the signal input terminal S of each of 
the selectors 1308, 1318, 1328 and 1338 of each of the processor elements PE1a(x,y) from the timing control unit 900, 
thereby causing the first data input terminal A of each of the selectors 1 308, 1 3 1 8, 1 328 and 1 338 to be electrically con- 
nected to the data output terminal Y of each of the selectors 1308, 1318, 1328 and 1338. In step with the pulse of the 

35 control signal CK2 in the period (I), each of the processor elements PE1a(x,y) outputs each of the distortion values 
through the data output terminals of each of the D flip-flop 1309, 1319, 1329, 1339 and the data output terminals Dlo, 
DVo, DHo and DDo of each of the processor elements PE1a(x,y) shown in FIG. 10. 

Each of the distortion values calculated by each of the processor elements PE1a(1 ,y) is received by the data input 
terminals I0-I9 of the selector 51 0 of the distortion selecting means 500 from each of the processor elements PE1 a(0,y) 

40 through the data output terminals Dlo, DVo, DDo, DHo of each of the processor elements PE1a(0,y). At the same time, 
each of the distortion values calculated by each of the processor elements PE1 a(2,y) is supplied from each of the proc- 
essor elements PE1a(1,y) to the left side processor elements PE1a(0,y) through the data output terminals Dlo, DVo, 
DHo and DDo of each of the processor elements PE1a(1 ,y) and the data input terminals Dli, DVi, DHi and DDi of the 
left side processor elements PE1a(0,y). 

45 In step with the pulse of the control signal CK2 in the period (m), each of the processor elements PE1a(x,y) outputs 
each of the distortion values through the data output terminals of each of the D flip-flop 1309, 1319, 1329, 1339 and the 
data output terminals Dlo, DVo, DHo and DDo of each of the processor elements PE1a(x,y) shown in FIG. 10. 

Each of the distortion values calculated by each of the processor elements PE1a(2.y) is received by the data input 
terminals I0-I9 of the selector 51 0 of the distortion selecting means 500 from each of the processor elements PE1 a(0,y) 

so through the data output terminals Dlo, DVo, DDo, DHo of each of the processor elements PE1a(0,y). 

Before the beginning of the period (k), the D flip-flop 550 detects a low-to-high transition of the control signal LD 
received by the first signal input terminal SOOa.and accordingly sets all data of the data output terminal of the D flip-flop 
550 to "1 ". The maximum value is received by the second data input terminal B of the comparator 530 from the D flip- 
flop 550 through the data output terminal of the D flip-flop 550. The control signal Si representative of "0" to "9" is 

55 received by the signal input terminal S of the selector 510 of the distortion selecting means 500 from the timing control 
unit 900, thereby causing each of the data input terminals I0-I9 of the selector 510 to be electrically connected to the 
data output terminal of the selector 510, successively. The distortion value are subsequently received by the first data 
input terminal A of the comparator 530 of the distortion selecting means 500 from the selector 510, while the value 
which indicate the minimum distortion is received by the second data input terminal B of the comparator 530 from the 
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D flip-flop 550. When the control signal UMASK represented by "1 " is received by the second signal input terminal B of 
the logical product element 531 from the timing control unit 900, a signal on the first input terminal A of the logical prod- 
uct element 531 is outputted through the signal output terminal of the logical product element 531. The signal outputted 
from the logical product element 531 and indicated by "Min" is received by the signal input terminal S of the selector 

5 540. When the signal "Min" on the signal input terminal S of the selector 540 is represented by 'T, the first data input 
terminal A of the selector 540 is electrically connected to the data output terminal Y of the selector 540. The distortion 
value on the first data input terminal A of the selector 540 is transmitted from the selector 540 to the D flip-flop 550 
through the data input terminal of the D flip-flop 550. In step with the pulse of the control signal CK3, the distortion value 
on the data input terminal of the D flip-flop 550 is outputted through the data output terminal of the D flip-flop 550. 

io During the period (k), each of the distortion values calculated by the processor elements PE1a(0,y) is compared by 
the comparator 530. During the period (I), each of the distortion values calculated by the processor elements PE 1 a( 1 , y) 
is compared by the comparator 530. During the period (m), each of the distortion values calculated by the processor 
elements PE1a(2,y) is compared by the comparator 530. 

It is assumed that the distortion values outputted from the data output terminals Dlo, DVo, DHo and DDo of each of 

75 the processor elements PE1a(x,y) are indicated by D(x,y), D(x,y+0.5), D(x+0.5 t y) and D(x+O.5,y+0.5), respectively. 
During each of the periods (k) to (m), each of the distortion values is received by the data input terminals 10 to 19 of the 
selector 510 of the distortion selecting means 500 as shown in FIG. 25. 

When the control signal UMASK received by the second signal input terminal B of the logical product element 531 
is represented by "1", the signal on the first signal input terminal A of the logical product element 531 is outputted 

20 through the signal output terminal of the logical product element 531 . When the signal outputted through the signal out- 
put terminal of the logical product element 531 is represented by "1 the first data input terminal A of the selector 540 
is electrically connected to the data output terminal Y of the selector 540, and accordingly the distortion value received 
from the selector 510 is outputted to the D flip-flop 550 through the data output terminal Y of the selector 540 and the 
data input terminal of the D flip-flop 550. 

25 When the control signal UMASK represents "1", the distortion values D(x t y) outputted at that time are designated 
and compared. Assuming that the control signal UMASK outputted from the timing control unit 900 has a signal pattern 
shown in FIG. 13, the distortion values D(0,0), D(0,0.5), D(0 t 1), D(0.5 ( 0), D(0. 5,0.5), D(0.5,1), D(1,0), D(1,0.5) and 
D(1 ,1) are compared by the comparator 530 in order to obtain the minimum distortion value. 

Before the beginning of the period (k), all the output of the count output terminal Qn of the quinary counter 610 

30 shown in FIG. 12 is set to "0" in accordance with the control signal LD. Likewise, all the output of count output terminal 
Qn of the quinary counter 620 is set to "0" in accordance with the control signal LD. 

After all the output of the count output terminal Qn of the quinary counter 620 are set to "0", the quinary counter 
620 counts up from "0" in step with the control signal CK3 received by the signal input terminal CK, and outputs, through 
the count output terminal Qn, the count number that reverts to "0" in the sequence of counting after reaching a maxi- 

35 mum value of "4". In addition, the quinary counter 620 outputs a carry signal through the signal output terminal CYo 
each time the count number reverts to "0". When the D flip-flop 640 detects a rising edge of a pulse received by the 
signal input terminal 640a, i.e., when the control signal "Min" received by the signal input terminal 640a of the D flip-flop 
640 from the logical product element 531 of the distortion selecting means 500 is changed from "0" to "1 ", the D flip-flop 
640 latches, on the data output terminal, data received at that time by the data input terminal and outputs the latched 

40 data as a vertical coordinate MVy of the motion vector. 

After all the output of the count output terminal Qn of the quinary counter 610 are set to "0", the quinary counter 
610 counts up from "0" in step with the carry signal received by the signal input terminal CYi, and outputs, through the 
count output terminal Qn, the count number that reverts to "0" in the sequence of counting after reaching a maximum 
value of "4". When the D flip-flop 630 detects a rising edge of a pulse received by the signal input terminal 630a, i.e., 

45 when the control signal "Min" received by the signal input terminal 630a of the D flip-flop 630 from the logical product 
element 531 of the distortion selecting means 500 is changed from "0" to "1", the D flip-flop 630 latches, on the data 
output terminal, data received at that time by the data input terminal and outputs the latched data as a horizontal coor- 
dinate MVx of the motion vector. 

When the comparisons of all the distortion values are finished, the minimum distortion value is outputted from the 

so data output terminal of the D flip-flop 550 of the distortion selecting means 500. At the same time, a motion vector cor- 
responding to the minimum distortion value is outputted from the data output terminals of the D flip-flops 630 and 640 
of the motion vector calculating means 600. 

According to the first embodiment, it is unnecessary for the motion estimation apparatus to directly calculate the 
interpolated blocks, thereby making it possible to make the apparatus small-sized and increase the calculation speed 

55 of the apparatus. Since the pel data sets of the template block 4a is calculated in accordance with an expression rep- 
resented by "a(x,y)-b(x,y)/2 ", an arithmetic element for calculating the difference data can be constituted by a sub- 
tracter, i.e., the subtracter 1303 shown in FIG. 10. 

The current picture Pa, the first reference picture Pb and the second reference picture Pc may form pictures of the 
video sequence at time to, t1 and t2, respectively. If the time to, t1 and t2 are defined as |t0-t1 1 =i[t0-t2| , a search window 
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within which the reference block 2 is searched can be relatively decreased in size. If the time to, t1 . t2 are defined as 
|t0-t1 |>|t0-t2| , the search window 3 can be relatively decreased in size. 

The motion estimation apparatus is provided with the second, third and fourth difference calculating means 1032 
to 1034, second, third and fourth converting means 1042 to 1044, and second, third and fourth distortion calculating 
means 1120, 1130 and 1140 in addition to the first difference calculating means 1031, the first converting means 1041 
and the first distortion calculating means 1110. Therefore, the motion estimation apparatus can perform multiple half- 
pel searches with the same number of pel references as single search. 

Although the adder 1333 of the processor element PE1a(x,y) is shown in FIG. 10 as receiving data from the multi- 
pliers 1324 of the processor elements PE1a(x,y) and PE1a(x,y+1), the adder 1333 of the processor element PE1a(x,y) 
may receive data from the multipliers 1314 of the processor elements PE1a(x,y) and PE1a(x+1 ,y). 

Referring now to FIGS. 26 to 28 of the accompanying drawings, a preferred second embodiment of the motion esti- 
mation apparatus according to the present invention will be described hereinafter. The second embodiment of the 
motion estimation apparatus includes the same means and constitutional elements as the first embodiment of the 
motion estimation apparatus does. The means and constitutional elements of the second embodiment are respectively 
designated by the reference numerals denoting the individual constitutional elements of the first embodiment for omit- 
ting repeated description thereof. The motion estimation apparatus is shown in FIG. 26 as comprising template block 
obtaining means 200b and distortion calculating means 1000b. The obtaining means 200b comprises a subtracter 230 
for receiving the multiplied data b(m,n)/2 from the multiplier 210 and the pel data a(m,n) of the current block 1 and sub- 
tracting the pel data of the current block 1 from the multiplied data to obtain a template block 4b shown in FIG. 28. The 
distortion calculating means 1000b comprises nine processor elements PE1b(x,y). In FIG. 27, each of the processor 
elements PE1b(x,y) includes a adder 1303' for receiving the pel data of the candidate block 6 from the D flip-flop 1302 
and the pet data of the template block 4b from the subtracter 230 of the template block obtaining means 200b shown in 
FIG. 26 and add the pel data of the candidate block 6 and the pel data of the template block 4b. The second embodi- 
ment of the motion estimation apparatus thus constructed also can calculate the same motion vector as the apparatus 
shown in FIG. 8. 

Referring to FIGS. 29 to 32 of the accompanying drawings, a preferred third embodiment of the motion estimation 
apparatus according to the present invention will be described hereinafter. The third embodiment of the motion estima- 
tion apparatus includes the same means and constitutional elements as the first embodiment of the motion estimation 
apparatus does. The means and constitutional elements of the third embodiment are respectively designated by the ref- 
erence numerals denoting the individual constitutional elements of the first embodiment for omitting repeated descrip- 
tion thereof. The motion estimation apparatus includes distortion calculating means 2000a shown in FIG. 29 and 
comprising pel data outputting means 2001, first difference calculating means 2010, first converting means 2110, first 
distortion calculating means 2210, second difference calculating means 2020, second converting means 2120, second 
distortion calculating means 2220, third difference calculating means 2030, third converting means 2130, third distor- 
tion calculating means 2230, fourth difference calculating means 2040, fourth converting means 2140 and fourth dis- 
tortion calculating means 2240. 

The pel data outputting means 2001 is operated to receive the integer pel data sets of the template block 4a from 
the template block data calculating means 200a and the integer pel data sets of the first candidate block from the can- 
didate block data calculating means 400, and output a pair of the integer pel data sets of the template block 4a and the 
candidate block 6 corresponding in position to each other to the first, second, third and fourth difference calculating 
means 2010, 2020, 2030 and 2040. 

On the basis of the integer pel data sets of each of the first candidate blocks and the integer pel data sets of the 
template block 4a, the first difference calculating means 2010 calculates first difference data sets each indicative of a 
difference between each pel data set of each of the interpolated blocks and each integer pel data set of the current 
block 1 corresponding in position to each other. The first converting means 2110 converts the first difference data sets 
to positive data sets, respectively. The first distortion calculating means 2210 calculates the sum of the converted first 
difference data sets based on each of the first candidate blocks to obtain each of the first distortion values. 

The second difference calculating means 2020 calculates the sum of two of the integer pel data sets included in 
the search window 3 and vertically deviated by one-pel pitch from each other, and multiplies the sum by 1/2 to obtain 
second difference data sets. The second converting means 2120 converts the second difference data sets to positive 
data sets, respectively. The second distortion calculating means 2220 calculates the sum of the converted second dif- 
ference data sets based on each of the second candidate blocks to obtain each of the second distortion values. 

The third difference calculating means 2030 calculates the sum of two of the integer pel data sets include in the 
search window 3 and horizontally deviated by one-pel pitch from each other, and multiplies the sum by 1/2 to obtain 
third difference data sets. The third converting means 2130 converts the third difference data sets to positive data sets, 
respectively. The third distortion calculating means 2230 calculates the sum of the converted third difference data sets 
based on each of the third candidate blocks to obtain each of the third distortion values. 

The fourth difference calculating means 2040 calculates the sum of four of the integer pel data sets included in the 
search window 3 and multiplies the sum by 1/4 to obtain fourth difference data sets. The four of the integer pel data sets 
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are arranged in the form of a square and deviated by one-pel pitch from one another. The fourth converting means 2140 
converts the fourth difference data sets to positive data sets, respectively. The fourth distortion calculating means 2240 
calculates the sum of the converted fourth difference data sets based on each of the fourth candidate blocks to obtain 
each of the fourth distortion values. 

5 The distortion calculating means 2000a is shown in FIG. 30 as comprising nine processor elements PE2a(x,y) set 

in the form of a matrix array. As shown in FIG. 31, each of the processor elements PE2a(x,y) has data input terminals 
X, YDi, YLi, YXi, Dli, DHi, DVi, DDi and YUi, and data output terminals YUo, YLo, Dlo. DHo, DVo, DDo and YDo. Each 
of the processor elements PE2a(x,y) further has signal input terminals (not shown) and signal output terminals (not 
shown) electrically connected to the timing control unit 900. 

io In FIG. 32, each of the processor elements PE2a(x,y) comprises adders 2313, 2323 and 2333, multipliers 2314, 
2324 and 2334, and subtracters 2315, 2325 and 2335. 

The adder 2313 of the processor element PE2a(x,y) is adapted to add data from the D flip-flop 1302 of the same * 
processor element PE2a(x,y) and data from the D flip-flop 2302 of the processor element PE2a(x,y+1) and to output 
the added data. The multiplier 2314 multiplies the data from the adder 231 3 by 1/2 and transmits the multiplied data to 

is the subtracter 2315. The subtracter 231 5 is operated to subtract the data outputted from the subtracter 220 shown in 
FIG. 30 from the data from the multiplier 2314 and to output the subtracted data to the positive transducer 1315. 

The adder 2323 of the processor element PE2a(x,y) is adapted to add data from the D flip-flop 1302 of the same 
processor element PE2a(x,y) and data from the D flip-flop 1302 of the processor element PE2a(x+1,y) and to output 
the added data. The multiplier 2324 multiplies the data from the adder 2323 by 1/2 and transmits the multiplied data to 

20 the subtracter 2325. The subtracter 2325 is operated to subtract the data outputted from the subtracter 220 shown in 
FIG. 30 from the data outputted from the multiplier 2324 and to output the subtracted data to the positive transducer 
1325. 

The adder 2333 of the processor element PE2a(x,y) is adapted to add data from the D flip-flop 1302 of the same 
processor element PE2a(x,y), data from the D flip-flop 1302 of the processor element PE2a(x,y+1) data from the D flip- 

25 flop 1302 of the processor element PE2a(x+1,y) and data from the D flip-flop 1302 of the processor element 
PE2a(x+1 ,y+1), and to output the added data. The multiplier 2334 multiplies the data from the adder 2333 by 1/4' and 
transmits the multiplied data to the subtracter 2335. The subtracter 2335 is operated to subtract the data outputted from 
the subtracter 220 shown in FIG. 30 from the data outputted from the multiplier 2334 and to output the subtracted data 
to the positive transducer 1335. 

30 As will be understood from the aforesaid recitation, the adders 2313, 2323 and 2333 directly receive the integer pel 
data of the search window 3 to generate the half-pel data included in the search window 3. The third embodiment of the 
motion estimation apparatus also can calculate the same motion vector as the apparatus shown in FIG. 8. 

Referring to FIGS. 33 to 34 of the accompanying drawings, a preferred fourth embodiment of the motion estimation 
apparatus according to the present invention will be described hereinafter. The fourth embodiment of the motion esti- 

35- mation apparatus includes the same means and constitutional elements as the second and third embodiments of the 
motion estimation apparatus does. The means and constitutional elements of the fourth embodiment are respectively 
designated by the reference numerals denoting the individual constitutional elements of the second and third embodi- 
ments for omitting repeated description thereof. The motion estimation apparatus is shown in FIG. 33 as comprising dis- 
tortion calculating means 2000b including nine processor elements PE2b(x,y). As shown in FIG. 34, each of the 

40 processor elements PE2b(x,y) comprises adders 2315', 2325' and 2335'. The adder 2315' receives the multiplied data 
from the multiplier 2314 and pel data of the template block 4b from the subtracter 230 shown in FIG. 33 and adds the 
received multiplied data and pel data. The output of the adder 231 5' is transmitted to the positive value transducer 1315. 
The adder 2325' receives the multiplied data from the multiplier 2324 and pel data of the template block 4b from the 
subtracter 230 shown in FIG. 33 and adds the received multiplied data and pel data. The output of the adder 2325' is 

45 transmitted to the positive value transducer 1 325. The adder 2335' receives the multiplied data from the multiplier 2334 
and pel data of the template block 4b from the subtracter 230 shown in FIG. 33 and adds the received multiplied data 
and pel data. The output of the adder 2335' is transmitted to the positive value transducer 1 335. The fourth embodiment 
of the motion estimation apparatus also can calculate the same motion vector as the apparatus shown in FIG. 8. 

Referring to FIGS. 35 to 37 of the accompanying drawings, a preferred fifth embodiment of the motion estimation 

so apparatus according to the present invention will be described hereinafter. The fifth embodiment of the motion estima- 
tion apparatus includes the same means and constitutional elements as the first embodiment of the motion estimation 
apparatus includes. The means and constitutional elements of the fifth embodiment are respectively designated by the 
reference numerals denoting the individual constitutional elements of the first embodiment for omitting repeated 
description thereof. The motion estimation apparatus is shown in FIG. 35 as comprising provisional template block 

55 obtaining means 700a, first selecting means 750, provisional candidate block obtaining means 800 and second select- 
ing means 850. The provisional template block obtaining means 700a is operated to obtain a provisional template block 
by multiplying pel data sets of the specified reference 2 block by the first coefficient E and by subtracting the multiplied 
pel data sets of the specified reference block 2 from the pel data sets of the current block 1 , respectively, so as to cal- 
culate pel data sets each indicative of a difference between each multiplied pel data set of the specified reference block 
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2 and each pel data set of the current block 1 corresponding in position to each other. The first selecting means 750 is 
operated to select one from the current block 1 and the provisional template block and output the selected block as a 
template block. The provisional candidate block obtaining means 800 is operated to obtain provisional candidate blocks 
by multiplying, by a second coefficient F, each of the pel data sets of the reference blocks 3c included in the search win- 
dow 3. The second selecting means 850 is operated to select one from a group of the candidate blocks 3c and a group 
of the 'provisional candidate blocks and output the selected blocks as candidate blocks. The reference blocks are 
selected when the current blocks are selected by the provisional template block obtaining means 700a. The provisional 
candidate blocks are selected when the provisional template blocks are selected by the provisional template block 
obtaining means 700a. 

The motion estimation apparatus is shown in FIG. 36 as comprising a timing control unit 950 which generates and 
outputs the same signals CK1, LD, CK2, CLE, SU, SL, Si, UMASK and CK3 as the timing control unit 900 does. The 
timing control unit 950 further generates a control signal MOD and outputs the control signal to the first selecting means 
750 and the second selecting means 850 through an output terminal SS. The selections by the first selecting means 
750 and the second selecting means 850 are made in accordance with the control signal MOD from the timing control 
unit 950. 

The provisional template block obtaining means 750a, the first selecting means 750, the provisional candidate 
block obtaining means 800 and the second selecting means 850 are concretely shown in FIGS. 37 and 40. The consti- 
tutional elements shown in FIGS. 37 and 40 are identical with those shown in FIGS. 8 and 30, respectively, except for 
the provisional template block obtaining means 750a, the first selecting means 750, the provisional candidate block 
obtaining means 800 and the second selecting means 850. 

The provisional template block obtaining means 750a includes the multipliers 21 0 and subtracter 220 described 
hereinbefore. The first selecting means 750 comprises a selector 751 which has data input terminals A and B, a data 
output terminal Y and a signal input terminal S. The selector 751 is operated to receive data from the subtracter 220 
through the data input terminal A and data indicative of the current block through data input terminal B and select either 
of the data input terminal A and the data on the data input terminal B in accordance with the control signal MOD on the 
signal input terminal S. In the present embodiment, the data input terminal A of the selector 751 is selected when the 
control signal MOD is representative of "1". The data input terminal B of the selector 751 is selected when the control 
signal MOD is representative of "0". The selected data is transmitted from the selector 751 through the signal input ter- 
minal Y to the processor elements PE1a(x,y). According to the fifth embodiment of the motion estimation apparatus, 
one motion estimation apparatus serves not only as an apparatus capable of performing interpolation prediction or 
dual-prime prediction but also as another apparatus capable of performing forward or backward prediction. 

Referring to FIGS. 38 and 39 of the accompanying drawings, a preferred sixth embodiment of the motion estimation 
apparatus according to the present invention will be described hereinafter. The sixth embodiment of the motion estima- 
tion apparatus includes the same means and constitutional elements as the second and fifth embodiments of the 
motion estimation apparatus does. The means and constitutional elements of the sixth embodiment are respectively 
designated by the reference numerals denoting the individual constitutional elements of the second and fifth embodi- 
ments for omitting repeated description thereof. As shown in FIG. 38, the motion estimation apparatus comprises nine 
processor elements PE3b(x,y). Each of the processor elements PE3b(x,y) includes an Exclusive-OR element 3303 and 
an adder 3304. The Exclusive-OR elements 3303 receives the pel data of the template block from the selector 751 
shown in FIG. 38 and the control signal MOD from the timing control unit 950 shown in FIG. 38. When the control signal 
MOD is representative of "0", the Exclusive-OR element 3303 outputs the received pel data of the template block as it 
is. When the control signal MOD is representative of 'T\ the Exclusive-OR element 3303 changes bits representing the 
received pel data of the template block from "0" to "1 " and from "1 " to "0" and outputs the changed pel data. When the 
control signal MOD is representative of "0", the adder 3304 adds the pel data of the candidate block from the D flip-flop 
1 302 and the changed pel data from the Exclusive-OR element 3303 and transmits the added data to the positive value 
transducer 1305. When the control signal MOD is representative of "1", the adder 3304 adds the pel data from the D 
flip-flop 1302, the changed pel data and data representative of "1", and transmits the added data to the positive value 
transducer 1305. The sixth embodiment of the motion estimation apparatus also can calculate the same motion vector 
as the apparatus shown in FIG. 26. 

Referring to FIG. 40 of the accompanying drawings, a preferred seventh embodiment of the motion estimation 
apparatus according to the present invention will be described hereinafter. The seventh embodiment of the motion esti- 
mation apparatus includes the same means and constitutional elements as the third and fifth embodiments of the 
motion estimation apparatus does. The means and constitutional elements of the seventh embodiment are respectively 
designated by the reference numerals denoting the individual constitutional elements of the third and fifth embodiments 
for omitting repeated description thereof. The seventh embodiment of the motion estimation apparatus also can calcu- 
late the same motion vector as the apparatus shown in FIG. 30. 

Referring to FIGS. 41 and 42 of the accompanying drawings, a preferred eighth embodiment of the motion estima- 
tion apparatus according to the present invention will be described hereinafter. The eighth embodiment of the motion 
estimation apparatus includes the same means and constitutional elements as the fourth and fifth embodiments of the 



32 



>: <EP 0723366A2J_> 



EP 0 723 366 A2 



motion estimation apparatus does. The means and constitutional elements of the eighth embodiment are respectively 
designated by the reference numerals denoting the individual constitutional elements of the fourth and fifth embodi- 
ments for omitting repeated description thereof. The motion estimation apparatus is shown in FIG. 41 as comprising 
nine processor elements PE4b(x,y). As shown in FIG. 42, each of the processor elements PE4b(x,y) comprises adders 

5 4305, 4315, 4325 and 4335, and Exclusive-OR elements 4350, 4351. 4352 and 4353. The Exclusive-OR elements 
4350 receives the pel data of the template block from the selector 751 shown in FIG. 41 and the control signal MOD 
from the timing control unit 950 shown in FIG. 41 . When the control signal MOD is representative of "0", each of the 
Exclusive-OR elements 4350, 4351 , 4352 and 4353 outputs the received pel data of the template block as it is. When 
the control signal MOD is representative of "1", each of the Exclusive-OR elements 4350, 4351, 4352 and 4353 

10 changes bits representing the received pel data from "1 " to "0" and from "0" to "1 When the control signal MOD is rep- 
resentative of "0", the adder 4305 adds the pel data from the D flip-flop 1302 and the changed pel data, and transmits 
the added data to the positive value transducer 1305. When the control signal MOD is representative of "1", the adder 
4305 adds the pel data from the D flip-flop 1 302, the changed pel data and data representative of "1 and transmits the 
added data to the positive value transducer 1 305. When the control signal MOD is representative of "0", the adder 431 5 

75 adds the pel data from the multiplier 2314 and the changed pel data, and transmits the added data to the positive value 
transducer 1315. When the control signal MOD is representative of "1 the adder 431 5 adds the pel data from the mul- 
tiplier 2314, the changed pel data and data representative of "1", and transmits the added data to the positive value 
transducer 1315. When the control signal MOD is representative of M 0", the adder 4325 adds the pel data from the mul- 
tiplier 2324 and the changed pel data, and transmits the added data to the positive value transducer 1325. When the 

20 control signal MOD is representative of "1", the adder 4325 adds the pel data from the multiplier 2324, the changed pel 
data and data representative of "1 ", and transmits the added data to the positive value transducer 1 325. When the con- 
trol signal MOD is representative of "0", the adder 4335 adds the pel data from the multiplier 2334 and the changed pel 
data, and transmits the added data to the positive value transducer 1335. When the control signal MOD is representa- 
tive of "1 the adder 4335 adds the pel data from the multiplier 2334, the changed pel data and data representative of 

25 "1". and transmits the added data to the positive value transducer 1335. The eighth embodiment of the motion estima- 
tion apparatus also can calculate the same motion vector as the apparatus shown in FIG. 30. 

The many features and advantages of the invention are apparent from the detailed specification and thus it is 
intended by the appended claims to cover all such features and advantages of the invention which fall within the true 
spirit and scope thereof. Further, since numerous modifications and changes will readily occur to those skilled in the 

30 art, it is not desired to limit the invention to the exact construction and operation illustrated and described, and accord- 
ingly, all suitable modifications and equivalents may be resorted to, falling with the scope of the invention. 

Claims 

35 1. A motion estimation method for calculating a motion vector to estimate a current picture (Pa) partially forming a 
video sequence on the basis of first and second reference pictures (Pb and Pc) partially forming said video 
sequence, said current picture (Pa) being partially formed by a current block (1) including a plurality of pels repre- 
sented by pel data sets, respectively said first reference picture (Pb) being formed by reference blocks each equal 
in size to said current block (1), each of the reference blocks of said first reference picture (Pb) including a plurality 

40 of pels represented by pel data sets, respectively said second reference picture (Pc) being formed by reference 
blocks (3c) each equal in size to said current block (1), each of the reference blocks (3c) of said second reference 
picture (Pc) including a plurality of pels represented by pel data sets, respectively, and said motion vector being 
indicative of a displacement between said current block (1 ) and one of the reference blocks (3c) of said second ref- 
erence picture (Pc), comprising the steps of: 

45 

(a) specifying a reference block (2) similar to said current block (1 ) from among the reference blocks of said first 
reference picture (Pb); 

(b) multiplying each pel data set of the specified reference block (2) by a first coefficient; 

(c) obtaining a template block (4a and 4b) by calculating pel data sets each indicative of a difference between 
so each multiplied pel data set of the specified reference block (2) and each pel data set of the current block (1) 

corresponding in position to each other; 

(d) specifying part or the whole of said second reference picture (Pc) as a search window (3); 

(e) obtaining candidate blocks (6) by multiplying, by a second coefficient, each of the pel data sets of the ref- 
erence blocks (3c) included in said search window (3); 

55 (f) calculating, on the basis of the pel data sets of each of candidate blocks (6) and the pel data sets of said 

template block (4a and 4b), distortion values each indicative of a difference between each of interpolated 
blocks and said current block (1 ), each of the interpolated blocks being indicative of a mean between the spec- 
ified reference block (2) of said first reference picture (Pb) and each of the reference blocks (3c) of said search 
window (3); 
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(g) selecting a minimum distortion value from among the distortion values; and 

(h) specifying a reference block (3c) of said second reference picture (Pc) bringing the minimum distortion 
value to obtain said motion vector. 

2. A motion estimation method as set forth in claim 1 , in which said obtaining step (c) comprises the step (d ) of sub- 
tracting the multiplied pel data sets of the specified reference block (2) from the pel data sets of said current block 
(1), respectively, to obtain said template block (4a), said calculating step (f) comprising the steps of: 

(f 1) subtracting the pel data sets of said template block (4a) from the pel data sets of each candidate block (6), 

respectively, to obtain local distortion values each indicative of a difference between each pel data set of each 

of the interpolated blocks and each pel data set of said template block (4a); 

(f2) converting the calculated local distortion values into positive values; and 

(f3) summing up the converted local distortion values to obtain said interpolated blocks. 

3. A motion estimation method as set forth in claim 1, in which the specifying step (a) comprises the step (a1) of 
selecting one most similar to said current block (1) from among the reference blocks of said first reference picture 
(Pb) by using of a motion compensation inter-frame predictive coding algorithm. 

4. A motion estimation method as set forth in claim 1 , in which said search window (3) is specified on the basis of a 
displacement between said current block (1 ) and the specified reference block (2) of said first reference picture (Pb) 
in said specified step (d). 

5. A motion estimation method as set forth in claim 4, in which said specifying step (d) comprises the step of: 

(dl) calculating a motion vector indicative of the displacement between said current block (1) and the specified 
reference block (2) of said first reference picture (Pb); and 

(d2) scaling the motion vector estimated in said estimating step (d1) with respect to said second reference pic- 
ture (Pc) to obtain a point on said first reference picture (Pb), said search window (3) being specified so as to 
include the point. 

6. A motion estimation method as set forth in claim 2, in which the local distortion values are converted to positive val- 
ues through absolute value arithmetic in said converting step (f2). 

7. A motion estimation method as set forth in claim 2, in which the local distortion values are converted to positive val- 
ues through square arithmetic in said converting step (f2). 

8. A motion estimation method as set forth in claim 1 , in which said current picture (Pa), said first reference picture 
(Pb) and said second reference picture (Pc) form pictures of said video sequence at time to, t1 and t2, respectively, 
tO, t1 and t2 being defined as |t0-t1|==|t0-t2| . 

9. A motion estimation method as set forth in claim 1 , in which said current picture (Pa), said first reference picture 
(Pb) and said second reference picture (Pc) form pictures of said video sequence at time tO, t1 and t2, respectively, 
to, tl and t2 being defined as |t0-t1 |>|t0-t2| . 

10. A motion estimation method as set forth in claim 1, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half-pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 
date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half-pels 
interposed between two of integer pels adjacent to each other, the integer pets of the first candidate blocks being 
represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said calculating step (f) comprising the steps of: 

(f 1) calculating, on the basis of the integer pel data sets of each of the first candidate blocks and the integer pel 
data sets of said template block (4a and 4b), first difference data sets each indicative of a difference between 
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each pel data set of each of said interpolated blocks and each integer pel data set of said current block (1) cor- 
responding in position to each other; 

(f2) calculating the sum of two of the first difference data sets vertically deviated by half-pel pitch from each 
other and multiplying the sum by 1/2 to obtain second difference data sets; 
s (f3) calculating the sum of two of the first difference data sets horizontally deviated by half-pel pitch from each 

other and multiplying the sum by 1/2 to obtain third difference data sets; 

(f4) calculating the sum of two of the second difference data sets horizontally deviated by half-pel pitch from 
each other and multiplying the calculated sum by 1/2 to obtain fourth difference data sets; 
(f5) converting the first, second, third and fourth difference data sets to positive values; 
10 (f6) calculating the sum of the converted first difference data sets based on each of the first candidate blocks 

to obtain each of the first distortion values; 

(f7) calculating the sum of the converted second difference data sets based on each of the second candidate 
blocks to obtain each of the second distortion values; 

(f8) calculating the sum of the converted third difference data sets based on each of the third candidate blocks 
15 to obtain each of the third distortion values; and 

(f9) calculating the sum of the converted fourth difference data sets based on each of the fourth candidate 
blocks to obtain each of the fourth distortion values. 

11. A motion estimation method as set forth in claim 1, in which the candidate blocks (6) consists of first candidate 
20 blocks, second candidate blocks each vertically deviated by half-pel pitch from each of the first candidate blocks, 

third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 
date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half -pels 
interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
25 represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said calculating step (f) comprising the steps of: 

30 

(f 1 ) calculating, on the basis of the integer pel data sets of each of the first candidate blocks and the integer pel 
data sets of said template block (4a and 4b), first difference data sets each indicative of a difference between 
each pel data set of each of said interpolated blocks and each integer pel data set of said current block (1 ) cor- 
responding in position to each other; 
35 (f2) calculating the sum of two of the first difference data sets vertically deviated by half-pel pitch from each 

other and multiplying the sum by 1/2 to obtain second difference data sets; 

(f3) calculating the sum of two of the first difference data sets horizontally deviated by half-pel pitch from each 
other and multiplying the sum by 1/2 to obtain third difference data sets; 

(f4) calculating the sum of two of the third difference data sets vertically deviated by half-pel pitch from each 
*o other and multiplying the calculated sum by 1/2 to obtain fourth difference data sets; 

(f5) converting the first, second, third and fourth difference data sets to positive values; 

(f6) calculating the sum of the converted first difference data sets based on each of the first candidate blocks 

to obtain each of the first distortion values; 

(f7) calculating the sum of the converted second difference data sets based on each of the second candidate 
45 blocks to obtain each of the second distortion values; 

(f8) calculating the sum of the converted third difference data sets based on each of the third candidate blocks 
to obtain each of the third distortion values; and 

(f9) calculating the sum of the converted fourth difference data sets based on each of the fourth candidate 
blocks to obtain each of the fourth distortion values. 

50 

12. A motion estimation method as set forth in claim 1, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half -pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 

55 date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half -pels 
interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
represented by integer pe! data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
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tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said calculating step (f) comprising the steps of: 

(f 1 ) calculating, on the basis of the integer pel data sets of each of the first candidate blocks and the integer pel 
data sets of said template block (4a and 4b), first difference data sets each indicative of a difference between 
each pel data set of each of said interpolated blocks and each integer pel data set of said current block (1) cor- 
responding in position to each other; 

(f2) calculating the sum of two of the integer pel data sets included in said search window (3) and vertically 
deviated by one-pel pitch from each other, and multiplying the sum by 1/2 to obtain second difference data 
sets; 

(f3) calculating the sum of two of the integer pel data sets include in said search window (3) and horizontally 

deviated by one-pel pitch from each other, and multiplying the sum by 1/2 to obtain third difference data sets; 

(f4) calculating the sum of four of the integer pel data sets included in said search window (3) and multiplying 

the sum by 1/4 to obtain fourth difference data sets, said four of the integer pel data sets being arranged in the 

form of a square and deviated by one-pel pitch from one another; 

(f5) converting the first, second, third and fourth difference data sets to positive values; 

(f6) calculating the sum of the converted first difference data sets based on each of the first candidate blocks 

to obtain each of the first distortion values; 

(f7) calculating the sum of the converted second difference data sets based on each of the second candidate 
blocks to obtain each of the second distortion values; 

(f8) calculating the sum of the converted third difference data sets based on each of the third candidate blocks 
to obtain each of the third distortion values; and 

(f9) calculating the sum of the converted fourth difference data sets based on each of the fourth candidate 
blocks to obtain each of the fourth distortion values. 

3, A motion estimation method as set forth in claim 1 , in which said obtaining step (c) comprises the step (d) of sub- 
tracting the pel data sets of said current block (1 ) from the multiplied pel data sets of the specified reference block 
(2), respectively, to obtain said template block (4b), said calculating step (f) comprising the steps of: 

(f 1 ) adding the pel data sets of said template block (4b) to the pel data sets of each candidate block (6), respec- 
tively, to obtain local distortion values each indicative of a difference between each pel data set of each of the 
interpolated blocks and each pel data set of said template block (4b); 
(f2) converting the calculated local distortion values into positive values; and 
(f3) summing up the converted local distortion values to obtain said interpolated blocks. 

4. A motion estimation apparatus for calculating a motion vector to estimate a current picture (Pa) partially forming a 
video sequence on the basis of first and second reference pictures (Pb and Pc) partially forming said video 
sequence, said current picture (Pa) being partially formed by a current block (1) including a plurality of pels repre- 
sented by pel data sets, respectively, said first reference picture (Pb) being formed by reference blocks each equal 
in size to said current block (1), each of the reference blocks of said first reference picture (Pb) including a plurality 
of pels represented by pel data sets, respectively, said second reference picture (Pc) being formed by reference 
blocks (3c) each equal in size to said current block (1), each of the reference blocks (3c) of said second reference 
picture (Pc) including a plurality of pels represented by pel data sets, respectively, and said motion vector being 
indicative of a displacement between said current block (1) and one of the reference blocks (3c) of said second ref- 
erence picture (Pc), comprising of: 

block specifying means (1 00) for specifying a reference block (2) similar to said current block (1 ) from among 
the reference blocks of said first reference picture (Pb); 

template block obtaining means (200a and 200b) for obtaining a template block (4a and 4b) by multiplying 
each pel data set of the specified reference block (2) by a first coefficient and by calculating pel data sets each 
indicative of a difference between each multiplied pel data set of the specified reference block (2) and each pel data 
set of the current block (1) corresponding in position to each other; 

search window specifying means (300) for specifying part or the whole of said second reference picture (Pc) 
as a search window (3); 

candidate block obtaining means (400) for obtaining candidate blocks (6) by multiplying, by a second coeffi- 
cient, each of the pel data sets of the reference blocks (3c) included in said search window (3); 

distortion calculating means (1000a, 2000a, 1000b and 2000b) for calculating, on the basis of the pel data 
sets of each of candidate blocks (6) and the pel data sets of said template block (4a and 4b), distortion values each 
indicative of a difference between each of interpolated blocks and said current block (1), each of the interpolated 
blocks being indicative of a mean between the specified reference block (2) of said first reference picture (Pb) and 
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each of the reference blocks (3c) of said search window (3); 

distortion selecting means (500) for selecting a minimum distortion value from among the distortion values; 

and 

motion vector calculating means (600) for calculating said motion vector by specifying a reference block (3c) 
5 of said second reference picture (Pc) bringing the minimum distortion value. 

15. A motion estimation apparatus as set forth in claim 14, in which said template block obtaining means (200a) com- 
prises: 

a multiplying unit (210) for multiplying the pel data sets of the specified reference block (2) by said first coef- 
w ficient; and 

a subtracting unit (220) for subtracting the multiplied pel data sets of the specified reference block (2) from 
the pel data sets of said current block (1 ), respectively, to obtain said template block (4a). 

16. A motion estimation apparatus as set forth in claim 15, in which said distortion calculating means (1000a and 
is 2000a) comprises: 

a subtracting unit (1303) for subtracting the pel data sets of said template block (4a) from the pel data sets 
of each candidate block (6), respectively, to obtain local distortion values each indicative of a difference between 
each pel data set of each of the interpolated blocks and each pel data set of said template block (4a); 

a converting unit (1305) for converting the calculated local distortion values into positive values; and 
20 a summing unit (1306) for summing up the converted local distortion values to obtain said interpolated 

blocks. 

17. A motion estimation apparatus as set forth in claim 14, in which the pels of said current block (1) are arranged in 
the form of a matrix array formed by M columns of N pels, said M and N being integers, respectively, the pels of 

25 said search window (3) being arranged in the form of a matrix array formed by L columns of H pels, said L and H 
being integers greater than said M and N, respectively, said distortion calculating means (1 000a, 2000a, 1 000b and 
2000b) comprising (L-M+1)x(H-N+1) processor elements each calculating each of said distortion values. 

18. A motion estimation apparatus as set forth in claim 14, in which said block specifying means (100) is operated to 
30 select one most similar to said current block (1 ) from among the reference blocks of said first reference picture (Pb) 

by using of a motion compensation inter-frame predictive coding algorithm. 

19. A motion estimation apparatus as set forth in claim 14, in which said search window specifying means (300) is 
operated to specify said search window (3) on the basis of a displacement between said current block (1) and the 

35 specified reference block (2) of said first reference picture (Pb). 

20. A motion estimation apparatus as set forth in claim 19, in which said search window specifying means (300) com- 
prises: 

estimating means for estimating a motion vector indicative of the displacement between said current block 
40 (1) and the specified reference block (2) of said first reference picture (Pb); and 

scaling means for scaling the motion vector estimated by estimating means with respect to said second ref- 
erence picture (Pc) to obtain a point on said first reference picture (Pb), said search window (3) being specified so 
as to include the point. 

45 21. A motion estimation apparatus as set forth in claim 16, in which said converting unit (1305) is operated to convert 
the local distortion values to positive values through absolute value arithmetic. 

22. A motion estimation apparatus as set forth in claim 16, in which said converting unit (1305) is operated to convert 
the local distortion values to positive values through square arithmetic. 

50 

23. A motion estimation apparatus as set forth in claim 1 4, in which said current picture (Pa), said first reference picture 
(Pb) and said second reference picture (Pc) form pictures of said video sequence at time to, t1 and t2, respectively, 
to, t1 and t2 being defined as |tO-t1|=i|tO-t2| . 

55 24. A motion estimation apparatus as set forth in claim 1 4, in which said current picture (Pa), said first reference picture 
(Pb) and said second reference picture (Pc) form pictures of said video sequence at time to, t1 and t2, respectively, 
to, t1 and t2 being defined as |t0-t1|>|t0-t2| . 
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25. A motion estimation apparatus as set forth in claim 1 4, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half-pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 
date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half-pels 
interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said distortion calculating means (1000a and 1000b) comprising: 

first difference calculating means (1031) for calculating, on the basis of the integer pel data sets of each of 
the first candidate blocks and the integer pel data sets of said template block (4a and 4b), first difference data sets 
each indicative of a difference between each pel data set of each of said interpolated blocks and each integer pel 
data set of said current block (1) corresponding in position to each other; second difference calculating means 
(1032) for calculating the sum of two of the first difference data sets vertically deviated by half-pel pitch from each 
other and multiplying the sum by 1/2 to obtain second difference data sets; 

third difference calculating means (1033) for calculating the sum of two of the first difference data sets hori- 
zontally deviated by half-pel pitch from each other and multiplying the sum by 1/2 to obtain third difference data 
sets; 

fourth difference calculating means (1034) for calculating the sum of two of the second difference data sets 
horizontally deviated by half-pel pitch from each other and multiplying the calculated sum by 1/2 to obtain fourth dif- 
ference data sets; 

first converting means (1041) for converting the first difference data sets to positive data sets; 

second converting means (1042) for converting the second difference data sets to positive data sets; 

third converting means (1043) for converting the third difference data sets to positive data sets; 

fourth converting means (1044) for converting the fourth difference data sets to positive data sets; 

first distortion calculating means (1110) for calculating the sum of the converted first difference data sets 
based on each of the first candidate blocks to obtain each of the first distortion values; 

second distortion calculating means (11 20) for calculating the sum of the converted second difference data 
sets based on each of the second candidate blocks to obtain each of the second distortion values; 

third distortion calculating means (1 130) for calculating the sum of the converted third difference data sets 
based on each of the third candidate blocks to obtain each of the third distortion values; and 

fourth distortion calculating means (1 1 40) for calculating the sum of the converted fourth difference data sets 
based on each of the fourth candidate blocks to obtain each of the fourth distortion values. 

26. A motion estimation apparatus as set forth in claim 1 4, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half-pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 
date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half -pels 
interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said distortion calculating means (1000a and 1000b) comprising: 

first difference calculating means (1031) for calculating, on the basis of the integer pel data sets of each of 
the first candidate blocks and the integer pel data sets of said template block (4a and 4b), first difference data sets 
each indicative of a difference between each pel data set of each of said interpolated blocks and each integer pel 
data set of said current block (1) corresponding in position to each other; second difference calculating means 
(1032) for calculating the sum of two of the first difference data sets vertically deviated by half -pel pitch from each 
other and multiplying the sum by 1/2 to obtain second difference data sets; 

third difference calculating means (1033) for calculating the sum of two of the first difference data sets hori- 
zontally deviated by half-pel pitch from each other and multiplying the sum by 1/2 to obtain third difference data 
sets; 

fourth difference calculating means (1034) for calculating the sum of two of the third difference data sets ver- 
tically deviated by half-pel pitch from each other and multiplying the calculated sum by 1/2 to obtain fourth differ- 
ence data sets; 
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first converting means (1 041 ) for converting the first difference data sets to positive data sets, respectively; 
second converting means (1042) for converting the second difference data sets to positive data sets, 
respectively; 

third converting means (1 043) for converting the third difference data sets to positive data sets, respectively; 
5 fourth converting means (1044) for converting the fourth difference data sets to positive data sets, respec- 

tively; 

first distortion calculating means (1110) for calculating the sum of the converted first difference data sets 
based on each of the first candidate blocks to obtain each of the first distortion values; 

second distortion calculating means (1 120) for calculating the sum of the converted second difference data 
10 sets based on each of the second candidate blocks to obtain each of the second distortion values; 

third distortion calculating means (1 130) for calculating the sum of the converted third difference data sets 
based on each of the third candidate blocks to obtain each of the third distortion values; and 

fourth distortion calculating means (1 1 40) for calculating the sum of the converted fourth difference data sets 
based on each of the fourth candidate blocks to obtain each of the fourth distortion values. 

15 

27. A motion estimation apparatus as set forth in claim 1 4, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half -pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 

20 date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half-pels 
interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
ts tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said distortion calculating means (2000a and 2000b) comprising: 

first difference calculating means (2010) for calculating, on the basis of the integer pel data sets of each of 
the first candidate blocks and the integer pel data sets of said template block (4a and 4b), first difference data sets 
each indicative of a difference between each pel data set of each of said interpolated blocks and each integer pel 
30 data set of said current block (1) corresponding in position to each other; 

second difference calculating means (2020) for calculating the sum of two of the integer pel data sets 
included in said search window (3) and vertically deviated by one-pel pitch from each other, and multiplying the sum 
by 1/2 to obtain second difference data sets; 

third difference calculating means (2030) for calculating the sum of two of the integer pel data sets include 
35 in said search window (3) and horizontally deviated by one-pel pitch from each other, and multiplying the sum by 
1/2 to obtain third difference data sets; 

fourth difference calculating means (2040) for calculating the sum of four of the integer pel data sets 
included in said search window (3) and multiplying the sum by 1/4 to obtain fourth difference data sets, said four of 
the integer pel data sets being arranged in the form of a square and deviated by one-pel pitch from one another; 
40 first converting means (2110) for converting the first difference data sets to positive data sets, respectively; 

second converting means (2120) for converting the second difference data sets to positive data sets, 
respectively; 

third converting means (2130) for converting the second difference data sets to positive data sets, respec- 
tively; 

45 fourth converting means (2140) for converting the third difference data sets to positive data sets, respec- 

tively; 

first distortion calculating means (2210) for calculating the sum of the converted first difference data sets 
based on each of the first candidate blocks to obtain each of the first distortion values; 

second distortion calculating means (2220) for calculating the sum of the converted second difference data 
so sets based on each of the second candidate blocks to obtain each of the second distortion values; 

third distortion calculating means (2230) for calculating the sum of the converted third difference data sets 
based on each of the third candidate blocks to obtain each of the third distortion values; and 

fourth distortion calculating means (2240) for calculating the sum of the converted fourth difference data sets 
based on each of the fourth candidate blocks to obtain each of the fourth distortion values. 

55 

28. A motion estimation apparatus as set forth in claim 14, in which said template block obtaining means (200b) com- 
prises: 

a multiplying unit (210) for multiplying the pel data sets of the specified reference block (2) by said first coef- 
ficient; and 
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a subtracting unit (230) for subtracting the pet data sets of said current block (1) from the multiplied pel data 
sets of the specified reference block (2), respectively, to obtain said template block (4b). 

29. A motion estimation apparatus as set forth in claim 28, in which said distortion calculating means (1000b and 
2000b) comprises: 

an adding unit (1303') for adding the pel data sets of said template block (4b) to the pel data sets of each 
candidate block (6), respectively, to obtain local distortion values each indicative of a difference between each pel 
data set of each of the interpolated blocks and each pel data set of said template block (4b); 

a converting unit (1305) for converting the calculated local distortion values into positive values; and 

a summing unit (1306) for summing up the converted local distortion values to obtain said interpolated 

blocks. 

30. A motion estimation apparatus for calculating a motion vector to estimate a current picture (Pa) partially forming a 
video sequence on the basis of first and second reference pictures (Pb and Pc) partially forming said video 
sequence, said current picture (Pa) being partially formed by a current block (1) including a plurality of pels repre- 
sented by pel data sets, respectively, said first reference picture (Pb) being formed by reference blocks each equal 
in size to said current block (1 ), each of the reference blocks of said first reference picture (Pb) including a plurality 
of pels represented by pel data sets, respectively, said second reference picture (Pc) being formed by reference 
blocks (3c) each equal in size to said current block (1), each of the reference blocks (3c) of said second reference 
picture (Pc) including a plurality of pels represented by pel data sets, respectively, and said motion vector being 
indicative of a displacement between said current block (1 ) and one of the reference blocks (3c) of said second ref- 
erence picture (Pc), comprising of: 

block specifying means (1 00) for specifying a reference block (2) similar to said current block (1 ) from among 
the reference blocks of said first reference picture (Pb); 

provisional template block obtaining means (700a and 700b) for obtaining a provisional template block by 
multiplying each pel data set of the specified reference block (2) by a first coefficient and by subtracting the multi- 
plied pel data sets of the specified reference block (2) from the pel data sets of said current block (1 ), respectively; 

first selecting means (750) for selecting one from said current block (1) and said provisional template block 
and outputting the selected current block (1 ) as a template block (4a and 4b); 

search window specifying means (300) for specifying part or the whole of said second reference picture (Pc) 
as a search window (3); provisional candidate block obtaining means (800) for obtaining provisional candidate 
blocks by multiplying, by a second coefficient, each pel data set of the reference blocks (3c) included in said search 
window (3); 

second selecting means (850) for selecting one from a group of said reference blocks (2) and a group of said 
provisional candidate blocks and outputting the selected reference blocks (2) as candidate blocks (6), said refer- 
ence blocks (2) being selected when said current blocks (1) are selected by said provisional template block obtain- 
ing means (700a and 700b), and said provisional candidate blocks being selected when said provisional template 
blocks are selected by said provisional template block obtaining means (700a and 700b); 

distortion calculating means (1000a, 2000a, 3000b and 4000b) for calculating, on the basis of the pel data 
sets of each of candidate blocks (6) and the pel data sets of said template block (4a and 4b), distortion values each 
indicative of a difference between each of interpolated blocks and said current block (1), each of the interpolated 
blocks being indicative of a mean between the specified reference block (2) of said first reference picture (Pb) and 
each of the reference blocks (3c) of said search window (3); 

distortion selecting means (500) for selecting a minimum distortion value from among the distortion values; 

and 

motion vector calculating means (600) for calculating said motion vector by specifying a reference block (3c) 
of said second reference picture (Pc) bringing the minimum distortion value. 

31. A motion estimation apparatus as set forth in claim 30. in which said distortion calculating means (1000a and 
2000a) comprises: 

a subtracting unit (1303) for subtracting the pel data sets of said template block (4a) from the pel data sets 
of each candidate block (6), respectively, to obtain local distortion values each indicative of a difference between 
each pel data set of each of the interpolated blocks and each pel data set of said template block (4a); 

a converting unit (1305) for converting the calculated local distortion values into positive values; and 

a summing unit (1306) for summing up the converted local distortion values to obtain said interpolated 

blocks. 

32. A motion estimation apparatus as set forth in claim 30, in which the pels of said current block (1) are arranged in 
the form of a matrix array formed by M columns of N pels, said M and N being integers, respectively, the pels of 
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said search window (3) being arranged in the form of a matrix array formed by L columns of H pels, said L and H 
being integers greater than said M and N, respectively, said distortion calculating means (1 000a, 2000a, 3000b and 
4000b) comprising (L-M+1)x(H-N+1) processor elements each calculating each of said distortion values. 

s 33. A motion estimation apparatus as set forth in claim 30, in which said block specifying means (100) is operated to 
select one most similar to said current block (1 ) from among the reference blocks of said first reference picture (Pb) 
by using of a motion compensation inter-frame predictive coding algorithm. 

34. A motion estimation apparatus as set forth in claim 30, in which said search window specifying means (300) is 
w operated to specify said search window (3) on the basis of a displacement between said current block (1 ) and the 

specified reference block (2) of said first reference picture (Pb). 

35. A motion estimation apparatus as set forth in claim 34, in which said search window specifying means (300) com- 
prises: 

is estimating means for estimating a motion vector indicative of the displacement between said current block 

(1) and the specified reference block (2) of said first reference picture (Pb); and 

scaling means for scaling the motion vector estimated by estimating means with respect to said second ref- 
erence picture (Pc) to obtain a point on said first reference picture (Pb), said search window (3) being specified so 
as to include the point. 

20 

36. A motion estimation apparatus as set forth in claim 31 , in which said converting unit (1305) is operated to convert 
the local distortion values to positive values through absolute value arithmetic. 

37. A motion estimation apparatus as set forth in claim 31 , in which said converting unit (1305) is operated to convert 
25 the local distortion values to positive values through square arithmetic. 

38. A motion estimation apparatus as set forth in claim 30, in which said current picture (Pa), said first reference picture 
(Pb) and said second reference picture (Pc) form pictures of said video sequence at time to, t1 and t2, respectively, 
to, t1 and t2 being defined as |t0-t1|=i|t0-t2| . 

30 

39. A motion estimation apparatus as set forth in claim 30, in which said current picture (Pa), said first reference picture 
(Pb) and said second reference picture (Pc) form pictures of said video sequence at time to, t1 and t2, respectively, 
to, t1 and t2 being defined as |t0-t1 |>|t0-t2| . 

35 40. A motion estimation apparatus as set forth in claim 30, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half-pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half-pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 
date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half-pels 

40 interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 

45 fourth candidate blocks, respectively, and said distortion calculating means (1000a and 3000b) comprising: 

first difference calculating means (1031) for calculating, on the basis of the integer pel data sets of each of 
the first candidate blocks and the integer pel data sets of said template block (4a), first difference data sets each 
indicative of a difference between each pel data set of each of said interpolated blocks and each integer pel data 
set of said current block (1) corresponding in position to each other; 

so second difference calculating means (1032) for calculating the sum of two of the first difference data sets 

vertically deviated by half-pel pitch from each other and multiplying the sum by 1/2 to obtain second difference data 
sets; 

third difference calculating means (1033) for calculating the sum of two of the first difference data sets hori- 
zontally deviated by half-pel pitch from each other and multiplying the sum by 1/2 to obtain third difference data 
55 sets; 

fourth difference calculating means (1034) for calculating the sum of two of the second difference data sets 
horizontally deviated by half -pel pitch from each other and multiplying the calculated sum by 1/2 to obtain fourth dif- 
ference data sets; 

first converting means (1041) for converting the first difference data sets to positive data sets; 
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second converting means (1042) for converting the second difference data sets to positive data sets; 

third converting means (1043) for converting the third difference data sets to positive data sets; 

fourth converting means (1044) for converting the fourth difference data sets to positive data sets; 

first distortion calculating means (1110) for calculating the sum of the converted first difference data sets 
based on each of the first candidate blocks to obtain each of the first distortion values; 

second distortion calculating means (1 1 20) for calculating the sum of the converted second difference data 
sets based on each of the second candidate blocks to obtain each of the second distortion values; 

third distortion calculating means (1 130) for calculating the sum of the converted third difference data sets 
based on each of the third candidate blocks to obtain each of the third distortion values; and 

fourth distortion calculating means (1 1 40) for calculating the sum of the converted fourth difference data sets 
based on each of the fourth candidate blocks to obtain each of the fourth distortion values. 

41 . A motion estimation apparatus as set forth in claim 30, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half -pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 
date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half-pels 
interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said distortion calculating means (1000a and 3000b) comprising: 

first difference calculating means (1031) for calculating, on the basis of the integer pel data sets of each of 
the first candidate blocks and the integer pel data sets of said template block (4a), first difference data sets each 
indicative of a difference between each pel data set of each of said interpolated blocks and each integer pel data 
set of said current block (1) corresponding in position to each other; 

second difference calculating means (1032) for calculating the sum of two of the first difference data sets 
vertically deviated by half -pel pitch from each other and multiplying the sum by 1/2 to obtain second difference data 
sets; 

third difference calculating means (1033) for calculating the sum of two of the first difference data sets hori- 
zontally deviated by half-pel pitch from each other and multiplying the sum by 1/2 to obtain third difference data 
sets; 

fourth difference calculating means (1 034) for calculating the sum of two of the third difference data sets ver- 
tically deviated by half-pel pitch from each other and multiplying the calculated sum by 1/2 to obtain fourth differ- 
ence data sets; 

first converting means (1 041 ) for converting the first difference data sets to positive data sets, respectively; 
second converting means (1042) for converting the second difference data sets to positive data sets, 
respectively; 

third converting means (1043) for converting the third difference data sets to positive data sets, respectively; 
fourth converting means (1044) for converting the fourth difference data sets to positive data sets, respec- 
tively; 

first distortion calculating means (1110) for calculating the sum of the converted first difference data sets 
based on each of the first candidate blocks to obtain each of the first distortion values; 

second distortion calculating means (1 120) for calculating the sum of the converted second difference data 
sets based on each of the second candidate blocks to obtain each of the second distortion values; 

third distortion calculating means (1 130) for calculating the sum of the converted third difference data sets 
based on each of the third candidate blocks to obtain each of the third distortion values; and 

fourth distortion calculating means (1 1 40) for calculating the sum of the converted fourth difference data sets 
based on each of the fourth candidate blocks to obtain each of the fourth distortion values. 

42. A motion estimation apparatus as set forth in claim 30, in which the candidate blocks (6) consists of first candidate 
blocks, second candidate blocks each vertically deviated by half-pel pitch from each of the first candidate blocks, 
third candidate blocks each horizontally deviated by half -pel pitch from each of the first candidate blocks, and fourth 
candidate blocks each diagonally deviated by half-pel pitch from each of the first candidate blocks, the first candi- 
date blocks being formed by integer pels, the second, third and fourth candidate blocks being formed by half-pels 
interposed between two of integer pels adjacent to each other, the integer pels of the first candidate blocks being 
represented by integer pel data sets, respectively, the half pels of each of the second, third and fourth candidate 
blocks being represented by half pel data sets, respectively, said distortion values consisting of first distortion val- 
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ues based on the first candidate blocks, second distortion values based on the second candidate blocks, respec- 
tively, third distortion values based on the third candidate blocks, respectively, fourth distortion values based on the 
fourth candidate blocks, respectively, and said distortion calculating means (2000a and 4000b) comprising: 

first difference calculating means (2010) for calculating, on the basis of the integer pel data sets of each of 
5 the first candidate blocks and the integer pel data sets of said template block (4b), first difference data sets each- 

indicative of a difference between each pel data set of each of said interpolated blocks and each integer pel data 
set of said current block (1) corresponding in position to each other; 

second difference calculating means (2020) for calculating the sum of two of the integer pel data sets 
included in said search window (3) and vertically deviated by one-pel pitch from each other, and multiplying the sum 
w by 1/2 to obtain second difference data sets; 

third difference calculating means (2030) for calculating the sum of two of the integer pel data sets include 
in said search window (3) and horizontally deviated by one-pel pitch from each other, and multiplying the sum by 
1/2 to obtain third difference data sets; 

fourth difference calculating means (2040) for calculating the sum of four of the integer pel data sets 
15 included in said search window (3) and multiplying the sum by 1/4 to obtain fourth difference data sets, said four of 
the integer pel data sets being arranged in the form of a square and deviated by one-pel pitch from one another; 

first converting means (2110) for converting the first difference data sets to positive data sets, respectively; 

second converting means (2120) for converting the second difference data sets to positive data sets, 
respectively; 

20 third converting means (2130) for converting the second difference data sets to positive data sets, respec- 

tively; 

fourth converting means (2140) for converting the third difference data sets to positive data sets, respec- 
tively; 

first distortion calculating means (2210) for calculating the sum of the converted first difference data sets 
25 based on each of the first candidate blocks to obtain each of the first distortion values; 

second distortion calculating means (2220) for calculating the sum of the converted second difference data 
sets based on each of the second candidate blocks to obtain each of the second distortion values; 

third distortion calculating means (2230) for calculating the sum of the converted third difference data sets 
based on each of the third candidate blocks to obtain each of the third distortion values; and 
30 fourth distortion calculating means (2240) for calculating the sum of the converted fourth difference data sets 

based on each of the fourth candidate blocks to obtain each of the fourth distortion values. 
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FIG.3 
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